00000001:02000400:1.0F:1787432466.843650:0:2984:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1787432487.727999:0:3206:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1787432489.642005:0:3269:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 783 MB/s 00000001:01000000:3.0:1787432489.895911:0:3269:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 425 MB/s 00000001:01000000:0.0F:1787432490.147980:0:3269:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4063 MB/s 00000020:02000000:1.0:1787432490.871561:0:3299:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_63_gaeb0ce0 00000400:02000000:0.0:1787432492.010746:0:3314:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.115@tcp [8/256/0/180] 00008000:02000000:0.0:1787432495.677192:0:3463:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1787432556.864190:0:5273:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787432567.893150:0:5847:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787432567.893156:0:5847:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787432567.893282:0:5847:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000016ae0c80 00000080:02000400:0.0:1787432567.893294:0:5847:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787432567.899727:0:5847:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787432567.899742:0:5847:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787432567.899779:0:5847:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000047ce8f45) 00000020:00000080:0.0:1787432567.899800:0:5847:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787432567.913728:0:5847:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787432567.914087:0:5847:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0F:1787432567.932044:0:5847:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787432567.932098:0:5847:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787432567.932117:0:5847:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787432567.932164:0:5847:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787432567.932188:0:5847:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787432567.932714:0:5847:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787432567.932724:0:5847:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787432567.932737:0:5847:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbcb9e331c3f0f72a 00000020:01000004:2.0:1787432567.932744:0:5847:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787432567.932749:0:5847:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787432567.932753:0:5847:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000016ae0c80 from MGS 00000020:01000004:2.0:1787432567.932759:0:5847:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787432567.932781:0:5847:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000084197ac8) 00000020:00000080:2.0:1787432567.932794:0:5847:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787432567.932861:0:5847:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000016ae0c80 from MGS, refs=2 00080000:01000000:2.0:1787432567.932867:0:5847:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787432567.932875:0:5847:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbcb9e331c3f0f738 00000100:00100000:2.0:1787432567.932970:0:5847:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787432567.933096:0:5847:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787432567.933102:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787432567.933890:0:5847:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787432567.933898:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787432567.934787:0:5847:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787432567.934952:0:5847:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787432567.934957:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787432567.936707:0:5847:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787432567.936723:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787432567.938141:0:5847:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787432567.938154:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787432567.939623:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432567.939628:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432567.939630:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432567.940077:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432567.940080:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432567.940082:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432567.940574:0:5847:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787432567.944471:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787432568.190306:0:5847:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4399 MB/s 00000001:01000000:2.0:1787432568.439813:0:5847:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5767 MB/s 00000001:01000000:2.0:1787432568.694753:0:5847:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 819 MB/s 00000001:01000000:3.0:1787432568.945707:0:5847:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 641 MB/s 00010000:00010000:1.0:1787432568.950029:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1787432568.954052:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1787432568.974566:0:5847:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787432568.974583:0:5847:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787432568.974585:0:5847:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787432568.981971:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787432568.982424:0:5847:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787432568.982488:0:5847:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787432568.982763:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787432568.982791:0:5847:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787432568.983101:0:5847:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787432568.983353:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787432568.983358:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787432568.985215:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787432568.985225:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787432568.986038:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787432568.986047:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787432568.987321:0:5847:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787432568.987347:0:5847:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.115@tcp' 00000020:01000004:1.0:1787432568.987349:0:5847:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787432568.987401:0:5847:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.115@tcp (typ=mgc) 00000020:00000080:1.0:1787432568.987419:0:5847:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.115@tcp (000000004ca4f4b8) 00000020:00000080:1.0:1787432568.987435:0:5847:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787432568.987546:0:5847:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f76f25d9@MGC192.168.202.115@tcp: add connection 192.168.202.115@tcp at head 00010000:00010000:1.0:1787432568.987730:0:5847:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.115@tcp-0 is initialized 00000040:01000000:1.0:1787432568.987736:0:5847:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787432568.989428:0:5863:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787432568.990938:0:5864:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787432568.991141:0:5847:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.115@tcp (uuid 2afcd650-d22d-4efa-b57b-1cd88d01ee9e) 00000020:00000080:3.0:1787432568.991163:0:5847:0:(genops.c:1385:class_connect()) connect: client 2afcd650-d22d-4efa-b57b-1cd88d01ee9e, cookie 0xbcb9e331c3f0f746 00000100:00080000:3.0:1787432568.991175:0:5847:0:(import.c:510:import_select_connection()) MGC192.168.202.115@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787432568.991180:0:5847:0:(import.c:624:import_select_connection()) MGC192.168.202.115@tcp: import 00000000f76f25d9 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:3.0:1787432568.991222:0:5847:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007b471aa7 x1874258812731520/t0(0) o250->MGC192.168.202.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787432568.991250:0:5847:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2afcd650-d22d-4efa-b57b-1cd88d01ee9e->MGS 00000020:01000004:3.0:1787432568.991279:0:5847:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787432568.991284:0:5847:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787432568.991304:0:5847:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000edf09faa) 00000020:00000080:3.0:1787432568.991317:0:5847:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787432568.993465:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b471aa7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3329:1874258812731520:0@lo:250: 00000100:00100000:1.0:1787432568.993557:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432569.006268:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812731520 00000100:00100000:0.0:1787432569.006282:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812731520 00000100:00100000:0.0:1787432569.006326:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432569.006335:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000597e0eb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3329:x1874258812731520:12345-0@lo:250: 00010000:00080000:0.0:1787432569.006365:0:5860:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2afcd650-d22d-4efa-b57b-1cd88d01ee9e@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:0.0:1787432569.006393:0:5860:0:(genops.c:1385:class_connect()) connect: client 2afcd650-d22d-4efa-b57b-1cd88d01ee9e, cookie 0xbcb9e331c3f0f754 00000100:00080000:0.0:1787432569.006524:0:5860:0:(import.c:65:import_set_state_nolock()) 000000004c33a235 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432569.007425:0:3329:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.115@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787432569.007437:0:3329:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.115@tcp: connect to target with instance 0 00000100:00080000:2.0:1787432569.007444:0:3329:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.115@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787432569.007449:0:3329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787432569.007452:0:3329:0:(import.c:65:import_set_state_nolock()) 00000000f76f25d9 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787432569.007455:0:3329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787432569.007465:0:3329:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787432569.007470:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b471aa7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3329:1874258812731520:0@lo:250: 00000100:00100000:0.0:1787432569.011709:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000597e0eb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+5:3329:x1874258812731520:12345-0@lo:250: Request processed in 320us (13098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432569.011728:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432569.022600:0:5847:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787432569.023413:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787432569.023421:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787432569.024471:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787432569.024482:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787432569.025069:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787432569.025078:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787432569.027061:0:5847:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787432569.027243:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787432569.027248:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787432569.028493:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787432569.028512:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787432569.082555:0:5847:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432569.082859:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787432569.082865:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787432569.087822:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787432569.087844:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787432569.092505:0:5847:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787432569.092731:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787432569.092737:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787432569.093199:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787432569.093205:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787432569.093846:0:5847:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787432569.094007:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787432569.094013:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787432569.095619:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787432569.095628:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787432569.096198:0:5847:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432569.096362:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787432569.096366:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787432569.097409:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787432569.097417:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787432569.185372:0:5847:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432569.185570:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787432569.185576:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787432569.191641:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787432569.191679:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787432569.195256:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787432569.195274:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787432569.196980:0:5847:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787432569.197005:0:5847:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787432569.197012:0:5847:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.115@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787432569.197152:0:5847:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787432569.197186:0:5847:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.115@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787432569.197191:0:5847:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787432569.197192:0:5847:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787432569.197194:0:5847:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432569.197195:0:5847:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432569.197201:0:5847:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432569.197202:0:5847:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432569.197203:0:5847:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787432569.197205:0:5847:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787432569.197206:0:5847:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787432569.197207:0:5847:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787432569.197208:0:5847:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432569.197210:0:5847:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787432569.197212:0:5847:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787432569.197214:0:5847:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787432569.197215:0:5847:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787432569.197216:0:5847:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432569.197217:0:5847:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432569.197218:0:5847:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432569.197219:0:5847:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432569.197220:0:5847:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787432569.197221:0:5847:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787432569.197221:0:5847:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787432569.197222:0:5847:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787432569.197223:0:5847:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432569.197224:0:5847:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787432569.197260:0:5847:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787432569.197278:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053abd4fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812731648:0@lo:253: 00000100:00100000:2.0:1787432569.197364:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432569.197416:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ec52edad going to sleep for 11 seconds 00000100:00100000:0.0:1787432569.197563:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812731648 00000100:00100000:0.0:1787432569.197571:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812731648 00000100:00100000:0.0:1787432569.197631:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432569.197640:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027c68b32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+5:5847:x1874258812731648:12345-0@lo:253: 20000000:01000000:0.0:1787432569.197707:0:5862:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787432569.197710:0:5862:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787432569.198234:0:5883:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787432569.198319:0:5862:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787432569.198599:0:5862:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787432569.199569:0:5884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787432569.203861:0:5862:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787432569.203869:0:5862:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787432569.203875:0:5862:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787432569.203879:0:5862:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787432569.203892:0:5862:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787432569.204097:0:5862:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787432569.204407:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787432569.204423:0:5862:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787432569.204482:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787432569.204515:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787432569.204535:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787432569.204588:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787432569.204593:0:5862:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787432569.204634:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787432569.204639:0:5862:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787432569.204683:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787432569.204691:0:5862:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787432569.204727:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787432569.204757:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787432569.204777:0:5862:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787432569.204781:0:5862:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787432569.204792:0:5862:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787432569.204972:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787432569.204982:0:5862:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787432569.205008:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787432569.205026:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787432569.205051:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787432569.205058:0:5862:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787432569.205100:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787432569.205105:0:5862:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787432569.205571:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787432569.205626:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787432569.205692:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787432569.205706:0:5862:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787432569.205815:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787432569.205826:0:5862:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787432569.205860:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787432569.205896:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787432569.206057:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787432569.206102:0:5862:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787432569.206121:0:5862:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787432569.206745:0:5885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787432569.207040:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787432569.207063:0:5862:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.115@tcp for mdt 20000000:01000000:0.0:1787432569.207070:0:5862:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.115@tcp (null) (null) (null) 00000040:00080000:0.0:1787432569.207329:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787432569.207345:0:5862:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787432569.207388:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787432569.207396:0:5862:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.115@tcp (null) (null) 00000040:00080000:0.0:1787432569.207752:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787432569.207774:0:5862:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787432569.207820:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787432569.207854:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787432569.207920:0:5862:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787432569.207924:0:5862:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787432569.207927:0:5862:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787432569.207946:0:5862:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787432569.207949:0:5862:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787432569.207990:0:5862:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787432569.207993:0:5862:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787432569.208898:0:5886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787432569.209297:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787432569.209362:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787432569.209452:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1787432569.209465:0:5862:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787432569.209467:0:5862:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787432569.209929:0:5887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787432569.210774:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787432569.210908:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787432569.211028:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1787432569.211044:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787432569.211047:0:5862:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1787432569.211052:0:5862:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787432569.211054:0:5862:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787432569.211059:0:5862:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787432569.211065:0:5862:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787432569.211812:0:5888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1787432569.211872:0:5862:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787432569.220285:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787432569.220364:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787432569.220435:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787432569.220457:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787432569.220477:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000dc1302b8/0xbcb9e331c3f0f75b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.220499:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dc1302b8/0xbcb9e331c3f0f75b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.220509:0:5862:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dc1302b8/0xbcb9e331c3f0f75b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.220514:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dc1302b8/0xbcb9e331c3f0f75b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.220744:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000dc1302b8/0xbcb9e331c3f0f75b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.220750:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000dc1302b8/0xbcb9e331c3f0f75b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.220757:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dc1302b8 already unused, calling callback (000000001273d40d) 00010000:00010000:0.0:1787432569.220760:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000dc1302b8/0xbcb9e331c3f0f75b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.220767:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000dc1302b8/0xbcb9e331c3f0f75b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.221001:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000dc1302b8/0xbcb9e331c3f0f75b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.221010:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000dc1302b8/0xbcb9e331c3f0f75b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.221016:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dc1302b8/0xbcb9e331c3f0f75b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787432569.221046:0:5862:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787432569.460538:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027c68b32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+5:5847:x1874258812731648:12345-0@lo:253: Request processed in 262893us (263168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432569.460551:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432569.460700:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053abd4fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812731648:0@lo:253: 10000000:01000000:2.0:1787432569.460714:0:5847:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787432569.460718:0:5847:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787432569.460720:0:5847:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787432569.460721:0:5847:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432569.460722:0:5847:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787432569.460723:0:5847:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432569.460725:0:5847:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432569.460726:0:5847:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787432569.460728:0:5847:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787432569.460729:0:5847:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787432569.460731:0:5847:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432569.460732:0:5847:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787432569.460767:0:5847:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000016ae0c80 from lustre-MDT0000 10000000:01000000:2.0:1787432569.460791:0:5847:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787432569.460794:0:5847:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787432569.460797:0:5847:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff935b879b0000 10000000:01000000:2.0:1787432569.460801:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787432569.460808:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff935b879b0000 from 1 10000000:01000000:2.0:1787432569.460811:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787432569.460847:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 0000000038cd653b/0xbcb9e331c3f0f762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.460855:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 0000000038cd653b/0xbcb9e331c3f0f762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.460862:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 0000000038cd653b/0xbcb9e331c3f0f762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432569.460876:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053abd4fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812731776:0@lo:101: 00000100:00100000:2.0:1787432569.460902:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432569.460949:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a7722f8a going to sleep for 11 seconds 00000100:00100000:0.0:1787432569.461851:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812731776 00000100:00100000:0.0:1787432569.461858:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812731776 00000100:00100000:0.0:1787432569.461890:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432569.461896:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006edf585e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+5:5847:x1874258812731776:12345-0@lo:101: 00010000:00010000:0.0:1787432569.461906:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432569.461916:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dc1302b8/0xbcb9e331c3f0f769 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f762 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.461935:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dc1302b8/0xbcb9e331c3f0f769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f762 expref: 6 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.461944:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dc1302b8/0xbcb9e331c3f0f769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f762 expref: 6 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.461952:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dc1302b8, rc 0) 00000100:00100000:0.0:1787432569.461999:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006edf585e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+6:5847:x1874258812731776:12345-0@lo:101: Request processed in 103us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432569.462004:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787432569.462094:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053abd4fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812731776:0@lo:101: 00010000:00010000:2.0:1787432569.462105:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 0000000038cd653b/0xbcb9e331c3f0f762 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f769 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.462169:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 0000000038cd653b/0xbcb9e331c3f0f762 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f769 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432569.462221:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053abd4fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812731904:0@lo:501: 00000100:00100000:2.0:1787432569.462248:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432569.462273:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a7722f8a going to sleep for 11 seconds 00000100:00100000:0.0:1787432569.462320:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812731904 00000100:00100000:0.0:1787432569.462324:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812731904 00000100:00100000:0.0:1787432569.462357:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432569.462363:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067d82bbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+6:5847:x1874258812731904:12345-0@lo:501: 00000100:00100000:0.0:1787432569.462921:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067d82bbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+6:5847:x1874258812731904:12345-0@lo:501: Request processed in 557us (671us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787432569.462937:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787432569.463058:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053abd4fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812731904:0@lo:501: 10000000:01000000:2.0:1787432569.463085:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787432569.463289:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 0000000038cd653b/0xbcb9e331c3f0f762 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f769 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.463296:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 0000000038cd653b/0xbcb9e331c3f0f762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f769 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432569.463302:0:5847:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff935b90e92000 10000000:01000000:2.0:1787432569.463306:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787432569.463309:0:5847:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff935b90e92000 10000000:01000000:2.0:1787432569.463312:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787432569.463314:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff935b90e92000 from 1 10000000:01000000:2.0:1787432569.463317:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787432569.463338:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 0000000074426fb1/0xbcb9e331c3f0f770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.463345:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 0000000074426fb1/0xbcb9e331c3f0f770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.463352:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 0000000074426fb1/0xbcb9e331c3f0f770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432569.463365:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053abd4fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812732032:0@lo:101: 00000100:00100000:2.0:1787432569.463388:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432569.463441:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a7722f8a going to sleep for 11 seconds 00000100:00100000:0.0:1787432569.463486:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812732032 00000100:00100000:0.0:1787432569.463490:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812732032 00000100:00100000:0.0:1787432569.463581:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432569.463587:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eebb609c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+6:5847:x1874258812732032:12345-0@lo:101: 00010000:00010000:0.0:1787432569.463594:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432569.463613:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008d24cf9a/0xbcb9e331c3f0f777 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f770 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.463634:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008d24cf9a/0xbcb9e331c3f0f777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f770 expref: 7 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.463643:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008d24cf9a/0xbcb9e331c3f0f777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f770 expref: 7 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.463651:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008d24cf9a, rc 0) 00000100:00100000:2.0:1787432569.463854:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eebb609c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+7:5847:x1874258812732032:12345-0@lo:101: Request processed in 267us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432569.463861:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787432569.463935:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053abd4fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812732032:0@lo:101: 00010000:00010000:1.0:1787432569.463947:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 0000000074426fb1/0xbcb9e331c3f0f770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f777 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432569.463954:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 0000000074426fb1/0xbcb9e331c3f0f770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f777 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432569.463969:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787432569.464020:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 0000000074426fb1/0xbcb9e331c3f0f770 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f777 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432569.464027:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 0000000074426fb1/0xbcb9e331c3f0f770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f777 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432569.464033:0:5847:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787432569.464037:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787432569.464041:0:5847:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff935b90e92000 10000000:01000000:1.0:1787432569.464044:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787432569.464047:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787432569.464049:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787432569.464082:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 000000001764bc95/0xbcb9e331c3f0f77e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432569.464089:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 000000001764bc95/0xbcb9e331c3f0f77e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432569.464095:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 000000001764bc95/0xbcb9e331c3f0f77e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432569.464107:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053bb4dec pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812732160:0@lo:101: 00000100:00100000:1.0:1787432569.464137:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432569.464165:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 000000006a6c7d1e going to sleep for 11 seconds 00000100:00100000:0.0:1787432569.464215:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812732160 00000100:00100000:0.0:1787432569.464219:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812732160 00000100:00100000:0.0:1787432569.464250:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787432569.464255:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059bdcdf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+7:5847:x1874258812732160:12345-0@lo:101: 00010000:00010000:0.0:1787432569.464260:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432569.464265:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009a1e87af/0xbcb9e331c3f0f785 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f77e expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.464275:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009a1e87af/0xbcb9e331c3f0f785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f77e expref: 8 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.464279:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009a1e87af/0xbcb9e331c3f0f785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f77e expref: 8 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.464291:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009a1e87af, rc 0) 00000100:00100000:0.0:1787432569.464326:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059bdcdf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+8:5847:x1874258812732160:12345-0@lo:101: Request processed in 70us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432569.464332:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787432569.464443:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053bb4dec pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812732160:0@lo:101: 00010000:00010000:3.0:1787432569.464452:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 000000001764bc95/0xbcb9e331c3f0f77e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f785 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432569.464456:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 000000001764bc95/0xbcb9e331c3f0f77e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f785 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432569.464487:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000106f3d79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812732288:0@lo:501: 00000100:00100000:3.0:1787432569.464508:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432569.464597:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000af743b89 going to sleep for 11 seconds 00000100:00100000:1.0:1787432569.464650:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812732288 00000100:00100000:1.0:1787432569.464654:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812732288 00000100:00100000:1.0:1787432569.464697:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787432569.464703:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef69a452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+8:5847:x1874258812732288:12345-0@lo:501: 00000100:00100000:1.0:1787432569.464922:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef69a452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+9:5847:x1874258812732288:12345-0@lo:501: Request processed in 218us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432569.464929:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787432569.465049:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000106f3d79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812732288:0@lo:501: 00000100:00100000:3.0:1787432569.465070:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000106f3d79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812732416:0@lo:503: 00000100:00100000:3.0:1787432569.465108:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432569.465138:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000af743b89 going to sleep for 11 seconds 00000100:00100000:0.0:1787432569.465190:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812732416 00000100:00100000:0.0:1787432569.465194:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812732416 00000100:00100000:0.0:1787432569.465224:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787432569.465230:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000100ac564 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+9:5847:x1874258812732416:12345-0@lo:503: 00000100:00100000:0.0:1787432569.465367:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000100ac564 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+9:5847:x1874258812732416:12345-0@lo:503: Request processed in 137us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432569.465373:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432569.465442:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000106f3d79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812732416:0@lo:503: 00000100:00100000:3.0:1787432569.465984:0:5890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000106f3d79 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5890:1874258812732544:0@lo:502: 00000100:00100000:3.0:1787432569.466018:0:5890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432569.466048:0:5890:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dfca62a6 going to sleep for 11 seconds 00000100:00100000:0.0:1787432569.466095:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812732544 00000100:00100000:0.0:1787432569.466099:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812732544 00000100:00100000:0.0:1787432569.466126:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787432569.466131:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068c4fe64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+9:5890:x1874258812732544:12345-0@lo:502: 00000100:00100000:0.0:1787432569.466282:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068c4fe64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+9:5890:x1874258812732544:12345-0@lo:502: Request processed in 151us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432569.466287:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787432569.466361:0:5890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000106f3d79 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5890:1874258812732544:0@lo:502: 00000020:01000000:1.0:1787432569.466384:0:5890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432569.466395:0:5890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432569.466398:0:5890:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787432569.466404:0:5890:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787432569.466407:0:5890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787432569.466419:0:5890:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000006e68825d) 00000020:00000080:1.0:1787432569.466437:0:5890:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787432569.466443:0:5890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787432569.466506:0:5890:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787432569.466510:0:5890:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbcb9e331c3f0f793 00000020:00000080:1.0:1787432569.466826:0:5890:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787432569.466830:0:5890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432569.466834:0:5890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432569.466835:0:5890:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787432569.466838:0:5890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432569.466842:0:5890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432569.466843:0:5890:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787432569.466846:0:5890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787432569.466852:0:5890:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000d590e254) 00000020:00000080:1.0:1787432569.466860:0:5890:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787432569.466871:0:5890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787432569.466873:0:5890:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787432569.466875:0:5890:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787432569.466881:0:5890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787432569.466927:0:5890:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000016ae0c80 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787432569.466940:0:5890:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000cff51694) 00000020:00000080:1.0:1787432569.466947:0:5890:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787432569.467000:0:5890:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787432569.467005:0:5890:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbcb9e331c3f0f7a8 00000020:00000080:1.0:1787432569.467076:0:5890:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787432569.467081:0:5890:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787432569.467084:0:5890:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbcb9e331c3f0f7af 00080000:01000000:1.0:1787432569.467087:0:5890:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787432569.467089:0:5890:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbcb9e331c3f0f7b6 00080000:10000000:1.0:1787432569.467415:0:5890:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1787432569.467817:0:5890:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787432569.470331:0:5890:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787432569.541027:0:5890:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787432569.541386:0:5890:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787432569.544161:0:5890:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787432569.544450:0:5890:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787432569.574945:0:5890:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000696aae80) 00000020:00000080:2.0:1787432569.574977:0:5890:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787432569.575063:0:5890:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787432569.575070:0:5890:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbcb9e331c3f0f7c4 00000020:00000080:0.0:1787432569.578114:0:5890:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1787432569.582836:0:5890:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787432569.613174:0:5890:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787432569.638960:0:5890:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787432569.686199:0:5890:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787432569.744458:0:5890:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787432569.851619:0:5890:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1787432569.949394:0:5890:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbcb9e331c3f0f7cb 00000020:00000080:1.0:1787432569.950258:0:5890:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787432569.950270:0:5890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432569.950277:0:5890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432569.950279:0:5890:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787432569.950282:0:5890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432569.950286:0:5890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432569.950287:0:5890:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787432569.950290:0:5890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787432569.950292:0:5890:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787432569.950408:0:5890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432569.950413:0:5890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432569.950415:0:5890:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787432569.950417:0:5890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432569.950421:0:5890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432569.950431:0:5890:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787432569.950436:0:5890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787432569.950477:0:5890:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1787432569.950547:0:5890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e70bc9c pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5890:1874258812732672:0@lo:502: 00000100:00100000:1.0:1787432569.950639:0:5890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432569.950735:0:5890:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fc318b44 going to sleep for 11 seconds 00000100:00100000:2.0:1787432569.950911:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812732672 00000100:00100000:2.0:1787432569.950928:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812732672 00000100:00100000:2.0:1787432569.950974:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787432569.950983:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079430e85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+9:5890:x1874258812732672:12345-0@lo:502: 00000100:00100000:2.0:1787432569.952026:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079430e85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+9:5890:x1874258812732672:12345-0@lo:502: Request processed in 1040us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432569.952037:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787432569.952812:0:5890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e70bc9c pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5890:1874258812732672:0@lo:502: 00000020:01000000:0.0:1787432569.953088:0:5890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432569.953096:0:5890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432569.953099:0:5890:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1787432569.953178:0:5890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787432569.953426:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787432569.953444:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787432569.953518:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 000000001764bc95/0xbcb9e331c3f0f77e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f785 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432569.953529:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 000000001764bc95/0xbcb9e331c3f0f77e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f785 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432569.953537:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff935b90e92000 from 1 10000000:01000000:3.0:1787432569.953539:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787432569.953572:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 00000000d83dfece/0xbcb9e331c3f0f7d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432569.953579:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 00000000d83dfece/0xbcb9e331c3f0f7d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432569.953587:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 00000000d83dfece/0xbcb9e331c3f0f7d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432569.953618:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000008d1cc8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812732800:0@lo:101: 00000100:00100000:3.0:1787432569.953704:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432569.953745:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000209d5c7a going to sleep for 11 seconds 00000100:00100000:1.0:1787432569.953868:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812732800 00000100:00100000:1.0:1787432569.953875:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812732800 00000100:00100000:1.0:1787432569.953933:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787432569.953942:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d89fa26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+9:5847:x1874258812732800:12345-0@lo:101: 00010000:00010000:1.0:1787432569.953954:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432569.953967:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a3727226/0xbcb9e331c3f0f7d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f7d2 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432569.953987:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a3727226/0xbcb9e331c3f0f7d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f7d2 expref: 10 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432569.953996:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a3727226/0xbcb9e331c3f0f7d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f7d2 expref: 10 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432569.954004:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a3727226, rc 0) 00000100:00100000:1.0:1787432569.954046:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d89fa26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+10:5847:x1874258812732800:12345-0@lo:101: Request processed in 106us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432569.954052:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787432569.954816:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000008d1cc8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812732800:0@lo:101: 00010000:00010000:3.0:1787432569.954835:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 00000000d83dfece/0xbcb9e331c3f0f7d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f7d9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432569.954844:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 00000000d83dfece/0xbcb9e331c3f0f7d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f7d9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432569.955875:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000008d1cc8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812732928:0@lo:256: 00000100:00100000:3.0:1787432569.956074:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432569.956119:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000209d5c7a going to sleep for 11 seconds 00000100:00100000:1.0:1787432569.956199:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812732928 00000100:00100000:1.0:1787432569.956206:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812732928 00000100:00100000:1.0:1787432569.956252:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787432569.956260:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5312722 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+10:5847:x1874258812732928:12345-0@lo:256: 20000000:01000000:1.0:1787432569.956278:0:5860:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787432569.956291:0:5860:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787432569.956379:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5312722 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+10:5847:x1874258812732928:12345-0@lo:256: Request processed in 120us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432569.956386:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787432569.956530:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000008d1cc8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812732928:0@lo:256: 10000000:01000000:0.0:1787432569.957219:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787432569.959153:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 00000000d83dfece/0xbcb9e331c3f0f7d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f7d9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.959170:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 00000000d83dfece/0xbcb9e331c3f0f7d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f7d9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432569.959233:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff935b90e92000 from 1 10000000:01000000:1.0:1787432569.959237:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787432569.959279:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 000000002c620040/0xbcb9e331c3f0f7e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432569.959286:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 000000002c620040/0xbcb9e331c3f0f7e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432569.959304:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 000000002c620040/0xbcb9e331c3f0f7e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432569.959327:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b38e60e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812733056:0@lo:101: 00000100:00100000:1.0:1787432569.959393:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432569.959434:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 0000000004835474 going to sleep for 11 seconds 00000100:00100000:0.0:1787432569.959648:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812733056 00000100:00100000:0.0:1787432569.959684:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812733056 00000100:00100000:0.0:1787432569.959730:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787432569.959738:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd3d466c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+10:5847:x1874258812733056:12345-0@lo:101: 00010000:00010000:0.0:1787432569.959750:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432569.959764:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005ccbbc6f/0xbcb9e331c3f0f7e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f7e0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.959785:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ccbbc6f/0xbcb9e331c3f0f7e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f7e0 expref: 11 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.959794:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005ccbbc6f/0xbcb9e331c3f0f7e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f7e0 expref: 11 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.959802:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005ccbbc6f, rc 0) 00000100:00100000:0.0:1787432569.959844:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd3d466c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:5847:x1874258812733056:12345-0@lo:101: Request processed in 106us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432569.959850:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787432569.960076:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b38e60e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812733056:0@lo:101: 00010000:00010000:3.0:1787432569.960090:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 000000002c620040/0xbcb9e331c3f0f7e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f7e7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432569.960097:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 000000002c620040/0xbcb9e331c3f0f7e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f7e7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432569.960152:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006ad2638e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812733184:0@lo:501: 00000100:00100000:3.0:1787432569.960182:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432569.960214:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 000000002db97048 going to sleep for 11 seconds 00000100:00100000:0.0:1787432569.960268:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812733184 00000100:00100000:0.0:1787432569.960272:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812733184 00000100:00100000:0.0:1787432569.960325:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787432569.960331:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008eb794a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:5847:x1874258812733184:12345-0@lo:501: 00000100:00100000:0.0:1787432569.960979:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008eb794a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:5847:x1874258812733184:12345-0@lo:501: Request processed in 648us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432569.960989:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787432569.961479:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006ad2638e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812733184:0@lo:501: 00000100:00100000:3.0:1787432569.961574:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006ad2638e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812733312:0@lo:503: 00000100:00100000:3.0:1787432569.961629:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432569.961685:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 000000002db97048 going to sleep for 11 seconds 00000100:00100000:1.0:1787432569.961753:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812733312 00000100:00100000:1.0:1787432569.961758:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812733312 00000100:00100000:1.0:1787432569.961799:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787432569.961806:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a324b4bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:5847:x1874258812733312:12345-0@lo:503: 00000040:00080000:1.0:1787432569.961846:0:5860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787432569.961889:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a324b4bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:5847:x1874258812733312:12345-0@lo:503: Request processed in 78us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432569.961896:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787432569.965153:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006ad2638e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812733312:0@lo:503: 00000040:00080000:0.0:1787432569.969088:0:5894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787432569.969281:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787432569.969312:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787432569.971710:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 000000002c620040/0xbcb9e331c3f0f7e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f7e7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432569.971730:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 000000002c620040/0xbcb9e331c3f0f7e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f7e7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432569.973763:0:5847:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787432569.973771:0:5847:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff935b90e92000 10000000:01000000:0.0:1787432569.973774:0:5847:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff935b90e92000 10000000:01000000:0.0:1787432569.973778:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787432569.973786:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff935b90e92000 from 1 10000000:01000000:0.0:1787432569.973789:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787432569.973865:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 0000000030f0db4e/0xbcb9e331c3f0f7ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.973877:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 0000000030f0db4e/0xbcb9e331c3f0f7ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432569.974032:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 0000000030f0db4e/0xbcb9e331c3f0f7ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432569.974434:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000441e5463 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812733440:0@lo:101: 00010000:00010000:3.0:1787432569.974446:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432569.974502:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432569.974591:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812733440 00000100:00100000:3.0:1787432569.974608:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812733440 00000100:00100000:2.0:1787432569.974624:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 000000005150aa5a going to sleep for 11 seconds 00000100:00100000:3.0:1787432569.974679:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787432569.974688:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023fbea6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:5847:x1874258812733440:12345-0@lo:101: 00010000:00010000:3.0:1787432569.974703:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432569.974717:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000608d63ee/0xbcb9e331c3f0f7f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f7ee expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432569.974742:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000608d63ee/0xbcb9e331c3f0f7f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f7ee expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432569.974751:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000608d63ee/0xbcb9e331c3f0f7f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f7ee expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432569.974761:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000608d63ee, rc 0) 00000100:00100000:3.0:1787432569.974809:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023fbea6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:5847:x1874258812733440:12345-0@lo:101: Request processed in 122us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432569.974825:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787432569.974965:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000441e5463 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812733440:0@lo:101: 00010000:00010000:2.0:1787432569.974978:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 0000000030f0db4e/0xbcb9e331c3f0f7ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f7f5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432569.974986:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 0000000030f0db4e/0xbcb9e331c3f0f7ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f7f5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432569.975039:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012c19df2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812733568:0@lo:501: 00000100:00100000:2.0:1787432569.975062:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432569.975083:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 000000005150aa5a going to sleep for 11 seconds 00000100:00100000:0.0:1787432569.975094:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812733568 00000100:00100000:0.0:1787432569.975098:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812733568 00000100:00100000:0.0:1787432569.975129:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787432569.975135:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064ad0286 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:5847:x1874258812733568:12345-0@lo:501: 00000100:00100000:0.0:1787432569.975444:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064ad0286 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:5847:x1874258812733568:12345-0@lo:501: Request processed in 309us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432569.975451:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787432569.975758:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012c19df2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812733568:0@lo:501: 00000100:00100000:2.0:1787432569.975787:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012c19df2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812733696:0@lo:503: 00000100:00100000:2.0:1787432569.975823:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432569.977740:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 000000005150aa5a going to sleep for 11 seconds 00000100:00100000:3.0:1787432569.977879:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812733696 00000100:00100000:3.0:1787432569.978032:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812733696 00000100:00100000:2.0:1787432569.978153:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787432569.978162:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4de3d0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:5847:x1874258812733696:12345-0@lo:503: 00000100:00100000:2.0:1787432569.978845:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4de3d0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:5847:x1874258812733696:12345-0@lo:503: Request processed in 683us (3020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432569.978855:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787432569.979112:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012c19df2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812733696:0@lo:503: 00000100:00100000:1.0:1787432569.979786:0:5895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bd35828 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5895:1874258812733824:0@lo:502: 00000100:00100000:1.0:1787432569.979836:0:5895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432569.979875:0:5895:0:(client.c:2715:ptlrpc_set_wait()) set 0000000037355b26 going to sleep for 11 seconds 00000100:00100000:0.0:1787432569.980035:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812733824 00000100:00100000:0.0:1787432569.980045:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812733824 00000100:00100000:0.0:1787432569.980078:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787432569.980083:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000624e5e34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:5895:x1874258812733824:12345-0@lo:502: 00000100:00100000:0.0:1787432569.980256:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000624e5e34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:5895:x1874258812733824:12345-0@lo:502: Request processed in 168us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432569.980264:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787432569.980427:0:5895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bd35828 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5895:1874258812733824:0@lo:502: 00000020:01000004:2.0:1787432569.980489:0:5895:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787432569.980503:0:5895:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000843e0bc6) 00000020:00000080:2.0:1787432569.980522:0:5895:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787432569.980609:0:5895:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000016ae0c80 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787432569.980614:0:5895:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000016ae0c80 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787432569.980616:0:5895:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000016ae0c80 4 00010000:00080000:2.0:1787432569.980683:0:5895:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000de9d98d@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.115@tcp at head 00010000:00010000:2.0:1787432569.984227:0:5895:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787432569.984706:0:5895:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787432569.984745:0:5895:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787432569.984757:0:5895:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbcb9e331c3f0f803 00000100:00080000:2.0:1787432569.984766:0:5895:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787432569.984772:0:5895:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000de9d98d using connection 192.168.202.115@tcp/0@lo 00000100:00100000:2.0:1787432569.984806:0:5895:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000de7d7973 x1874258812733952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787432569.984959:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de7d7973 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874258812733952:0@lo:38: 00000100:00100000:1.0:1787432569.985030:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787432569.985139:0:5895:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787432569.985497:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812733952 00000100:00100000:3.0:1787432569.985506:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812733952 00000100:00100000:3.0:1787432569.985592:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432569.985609:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088f55b94 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3329:x1874258812733952:12345-0@lo:38: 00000100:00100000:3.0:1787432569.985689:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088f55b94 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3329:x1874258812733952:12345-0@lo:38: Request processed in 79us (659us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787432569.985706:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432569.985775:0:3329:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787432569.985782:0:3329:0:(import.c:65:import_set_state_nolock()) 000000000de9d98d lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432569.985787:0:3329:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787432569.985789:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de7d7973 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874258812733952:0@lo:38: 00000100:00100000:2.0:1787432569.990647:0:5895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dac10d2d pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5895:1874258812734080:0@lo:502: 00000100:00100000:2.0:1787432569.990752:0:5895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432569.990798:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812734080 00000100:00100000:2.0:1787432569.990805:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812734080 00000100:00100000:2.0:1787432569.990870:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787432569.990879:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b3077b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:5895:x1874258812734080:12345-0@lo:502: 00000100:00100000:2.0:1787432569.991121:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b3077b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:5895:x1874258812734080:12345-0@lo:502: Request processed in 243us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432569.991129:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787432569.991187:0:5895:0:(client.c:2715:ptlrpc_set_wait()) set 000000005150aa5a going to sleep for 11 seconds 00000100:00100000:2.0:1787432569.991209:0:5895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dac10d2d pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5895:1874258812734080:0@lo:502: 00000040:00080000:2.0:1787432569.991234:0:5895:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1787432569.991913:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1787432569.991939:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787432569.991957:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 0000000030f0db4e/0xbcb9e331c3f0f7ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f7f5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432569.991968:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 0000000030f0db4e/0xbcb9e331c3f0f7ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f7f5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787432569.992013:0:5847:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787432569.992015:0:5847:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787432569.992017:0:5847:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432569.992017:0:5847:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432569.992018:0:5847:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432569.992020:0:5847:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432569.992021:0:5847:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787432569.992022:0:5847:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787432569.992024:0:5847:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787432569.992025:0:5847:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787432569.992027:0:5847:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432569.992028:0:5847:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787432569.992032:0:5847:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1787432569.992034:0:5847:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787432569.992036:0:5847:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787432569.992037:0:5847:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432569.992038:0:5847:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432569.992039:0:5847:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432569.992040:0:5847:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432569.992041:0:5847:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787432569.992042:0:5847:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787432569.992043:0:5847:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787432569.992044:0:5847:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787432569.992045:0:5847:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432569.992046:0:5847:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787432569.992064:0:5847:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787432569.992074:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006ad2638e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812734208:0@lo:253: 00000100:00100000:3.0:1787432569.992127:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432569.992160:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 000000008bea29d3 going to sleep for 11 seconds 00000100:00100000:1.0:1787432569.992441:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812734208 00000100:00100000:1.0:1787432569.992450:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812734208 00000100:00100000:1.0:1787432569.992495:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787432569.992502:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ed2d03e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:5847:x1874258812734208:12345-0@lo:253: 20000000:01000000:1.0:1787432569.992524:0:5860:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787432569.992537:0:5860:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787432570.050261:0:5860:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787432570.050283:0:5860:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787432570.050343:0:5883:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787432570.050349:0:5883:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787432570.050372:0:5883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000de15e615/0xbcb9e331c3f0f80a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.050392:0:5883:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a3727226/0xbcb9e331c3f0f7d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f7d2 expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.050401:0:5883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000de15e615/0xbcb9e331c3f0f80a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.050442:0:5883:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a3727226/0xbcb9e331c3f0f7d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f7d2 expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.050457:0:5883:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a3727226/0xbcb9e331c3f0f7d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f7d2 expref: 12 pid: 5861 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432570.050470:0:5883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dac10d2d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5883:1874258812734336:0@lo:104: 00000100:00100000:2.0:1787432570.050548:0:5883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432570.050624:0:5883:0:(client.c:2715:ptlrpc_set_wait()) set 000000009269b3b0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432570.050737:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812734336 00000100:00100000:1.0:1787432570.050745:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812734336 00000100:00100000:1.0:1787432570.050797:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432570.050805:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000774dacbd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+3:5883:x1874258812734336:12345-0@lo:104: 00010000:00010000:1.0:1787432570.050827:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: 00000000d83dfece/0xbcb9e331c3f0f7d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f7d9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.050895:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787432570.050901:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000774dacbd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+3:5883:x1874258812734336:12345-0@lo:104: Request processed in 98us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432570.050909:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787432570.050931:0:5855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432570.050936:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: 00000000d83dfece/0xbcb9e331c3f0f7d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f7d9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.050960:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d83dfece already unused, calling callback (00000000abb2be14) 10000000:00010000:1.0:1787432570.050964:0:5855:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: 00000000d83dfece/0xbcb9e331c3f0f7d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f7d9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.050971:0:5855:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: 00000000d83dfece/0xbcb9e331c3f0f7d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f7d9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432570.050977:0:5855:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: 00000000d83dfece/0xbcb9e331c3f0f7d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f7d9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432570.050983:0:5855:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432570.051011:0:5855:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: 00000000d83dfece/0xbcb9e331c3f0f7d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f7d9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.051018:0:5855:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787432570.051022:0:5883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dac10d2d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5883:1874258812734336:0@lo:104: 00010000:00010000:1.0:1787432570.051034:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: 00000000d83dfece/0xbcb9e331c3f0f7d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f7d9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.051039:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: 00000000d83dfece/0xbcb9e331c3f0f7d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f7d9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432570.051040:0:5883:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000de15e615/0xbcb9e331c3f0f80a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432570.051056:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432570.051058:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432570.051060:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432570.051111:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd840427 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812734464:0@lo:103: 00000100:00100000:1.0:1787432570.051140:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432570.051982:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812734464 00000100:00100000:3.0:1787432570.051991:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812734464 00010000:00010000:3.0:1787432570.052014:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a3727226/0xbcb9e331c3f0f7d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f7d2 expref: 13 pid: 5861 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432570.052039:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432570.052047:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d7fb5ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:3331:x1874258812734464:12345-0@lo:103: 00010000:00010000:3.0:1787432570.052057:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432570.052062:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a3727226/0xbcb9e331c3f0f7d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f7d2 expref: 13 pid: 5861 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.052071:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a3727226/0xbcb9e331c3f0f7d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f7d2 expref: 13 pid: 5861 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.052086:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a3727226/0xbcb9e331c3f0f7d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f7d2 expref: 13 pid: 5861 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.052101:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000de15e615/0xbcb9e331c3f0f80a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.052108:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000de15e615/0xbcb9e331c3f0f80a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787432570.052122:0:5851:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001773828s 00010000:00010000:3.0:1787432570.052126:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000de15e615/0xbcb9e331c3f0f80a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.052132:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000de15e615/0xbcb9e331c3f0f80a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.052151:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000de15e615/0xbcb9e331c3f0f80a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.052158:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000de15e615/0xbcb9e331c3f0f80a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.052163:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000de15e615 already unused, calling callback (000000001273d40d) 00010000:00010000:3.0:1787432570.052166:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000de15e615/0xbcb9e331c3f0f80a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.052172:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000de15e615/0xbcb9e331c3f0f80a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.052194:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000de15e615/0xbcb9e331c3f0f80a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432570.052204:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432570.052239:0:5883:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000de15e615/0xbcb9e331c3f0f80a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432570.052250:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d7fb5ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:3331:x1874258812734464:12345-0@lo:103: Request processed in 205us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432570.052257:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787432570.052257:0:5883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000de15e615/0xbcb9e331c3f0f80a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432570.052263:0:5883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000de15e615/0xbcb9e331c3f0f80a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432570.052325:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd840427 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812734464:0@lo:103: 00000100:00100000:3.0:1787432570.063382:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ed2d03e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:5847:x1874258812734208:12345-0@lo:253: Request processed in 70873us (71247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432570.063399:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787432570.063580:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006ad2638e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5847:1874258812734208:0@lo:253: 10000000:01000000:2.0:1787432570.063609:0:5847:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787432570.063613:0:5847:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787432570.063615:0:5847:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787432570.063616:0:5847:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432570.063617:0:5847:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432570.063619:0:5847:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432570.063620:0:5847:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432570.063621:0:5847:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787432570.063623:0:5847:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787432570.063624:0:5847:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787432570.063626:0:5847:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787432570.063627:0:5847:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432570.063629:0:5847:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787432570.063644:0:5847:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787432570.069919:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787432570.070555:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787432570.070886:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787432570.071068:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787432570.071238:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787432570.071387:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787432570.072713:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787432570.072920:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787432570.073120:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787432570.073298:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787432570.073604:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787432570.073892:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1787432570.105691:0:5847:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787432570.130146:0:5847:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787432570.130484:0:5900:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1787432570.130489:0:5900:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787432570.130714:0:5901:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787432570.137225:0:5847:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787432570.137571:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787432570.138223:0:5847:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787432570.138234:0:5847:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787432570.138379:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787432570.141173:0:5847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787432570.142893:0:5847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787432570.142947:0:5847:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787432570.143270:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787432570.143443:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787432570.145960:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787432570.146134:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787432570.146287:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787432570.146436:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787432570.146737:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787432570.146860:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787432570.147006:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787432570.147138:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787432570.147294:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787432570.147429:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787432570.147697:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787432570.147827:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787432570.147976:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787432570.148114:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787432570.148249:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787432570.148384:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787432570.153177:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787432570.153365:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787432570.154930:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787432570.155156:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787432570.155319:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787432570.155492:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787432570.157862:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787432570.157996:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787432570.158130:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787432570.158240:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787432570.158376:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787432570.161314:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787432570.161572:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787432570.162108:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787432570.162247:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787432570.162385:0:5847:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787432570.162649:0:5847:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787432570.170853:0:5901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1787432570.212971:0:5847:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787432570.213006:0:5847:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9ea401a3b988 00100000:10000000:3.0:1787432570.213013:0:5847:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787432570.213627:0:5847:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787432570.213647:0:5847:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.115@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787432570.213689:0:5847:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787432570.213714:0:5847:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1787432570.267318:0:5901:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787432570.267410:0:5901:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787432570.267414:0:5901:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787432571.002969:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432572.022136:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432573.054046:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432574.072929:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787432574.698186:0:6143:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787432575.094286:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787432575.222095:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787432575.222104:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787432575.222107:0:37:0:(import.c:65:import_set_state_nolock()) 000000000de9d98d lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787432575.222121:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000de9d98d using connection 192.168.202.115@tcp/0@lo 00000100:00100000:2.0:1787432575.222140:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003504b88e x1874258812734720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787432575.222440:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000732ccc1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812734592:0@lo:400: 00000100:00100000:0.0:1787432575.222517:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432575.223410:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812734592 00000100:00100000:2.0:1787432575.223420:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812734592 00000100:00100000:2.0:1787432575.223484:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787432575.223495:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004880f228 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:3332:x1874258812734592:12345-0@lo:400: 00000100:00100000:2.0:1787432575.223645:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004880f228 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:3332:x1874258812734592:12345-0@lo:400: Request processed in 152us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432575.223654:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787432575.224108:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000732ccc1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812734592:0@lo:400: 00000100:00100000:0.0:1787432575.225628:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003504b88e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874258812734720:0@lo:38: 00000100:00100000:0.0:1787432575.225768:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432575.226058:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812734720 00000100:00100000:2.0:1787432575.226066:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812734720 00000100:00100000:2.0:1787432575.226111:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432575.226117:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab17cccd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3329:x1874258812734720:12345-0@lo:38: 00010000:00080000:2.0:1787432575.226142:0:5869:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:2.0:1787432575.226179:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbcb9e331c3f0f811 00000004:00100000:2.0:1787432575.226225:0:5869:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787432575.226342:0:5869:0:(import.c:65:import_set_state_nolock()) 00000000451a4c7e : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432575.226473:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab17cccd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874258812734720:12345-0@lo:38: Request processed in 355us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432575.226482:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:2.0:1787432575.230053:0:5864:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787432575.230065:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff935b90e92000 from 3 10000000:01000000:2.0:1787432575.230070:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787432575.230133:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 00000000de15e615/0xbcb9e331c3f0f818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432575.230145:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 00000000de15e615/0xbcb9e331c3f0f818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432575.230156:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 00000000de15e615/0xbcb9e331c3f0f818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432575.230177:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa8fd51e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812734848:0@lo:101: 00000100:00100000:2.0:1787432575.230254:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432575.230299:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set 0000000064b6c6fb going to sleep for 11 seconds 00000100:00100000:1.0:1787432575.230389:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812734848 00000100:00100000:1.0:1787432575.230397:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812734848 00000100:00100000:1.0:1787432575.230465:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787432575.230474:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023a94bde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:5864:x1874258812734848:12345-0@lo:101: 00010000:00010000:1.0:1787432575.230487:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432575.230499:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000006ef6c66/0xbcb9e331c3f0f81f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f818 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432575.230520:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000006ef6c66/0xbcb9e331c3f0f81f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f818 expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432575.230531:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000006ef6c66/0xbcb9e331c3f0f81f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f818 expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432575.230540:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000006ef6c66, rc 0) 00000100:00100000:1.0:1787432575.230587:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023a94bde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:5864:x1874258812734848:12345-0@lo:101: Request processed in 115us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432575.230594:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787432575.230638:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa8fd51e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812734848:0@lo:101: 00010000:00010000:1.0:1787432575.230683:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 00000000de15e615/0xbcb9e331c3f0f818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f81f expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432575.230692:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 00000000de15e615/0xbcb9e331c3f0f818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f81f expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432575.231145:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd840427 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812734976:0@lo:256: 00000100:00100000:1.0:1787432575.231177:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432575.231205:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set 00000000566e4608 going to sleep for 11 seconds 00000100:00100000:0.0:1787432575.232020:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812734976 00000100:00100000:0.0:1787432575.232030:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812734976 00000100:00100000:0.0:1787432575.232075:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787432575.232083:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b27372e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:5864:x1874258812734976:12345-0@lo:256: 20000000:01000000:0.0:1787432575.232117:0:5862:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787432575.232134:0:5862:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787432575.232136:0:5862:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787432575.232230:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b27372e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:5864:x1874258812734976:12345-0@lo:256: Request processed in 148us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432575.232238:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787432575.236927:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd840427 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812734976:0@lo:256: 10000000:01000000:1.0:1787432575.237001:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787432575.237010:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 00000000de15e615/0xbcb9e331c3f0f818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f81f expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432575.237021:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 00000000de15e615/0xbcb9e331c3f0f818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f81f expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1787432575.238677:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003504b88e x1874258812734720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787432575.238700:0:3329:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787432575.238708:0:3329:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787432575.238860:0:3329:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787432575.238864:0:3329:0:(import.c:65:import_set_state_nolock()) 000000000de9d98d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787432575.238871:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003504b88e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874258812734720:0@lo:38: 00010000:00010000:3.0:1787432576.121251:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432577.142467:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432578.166135:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432579.191693:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787432579.575962:0:6345:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeee02d2b0 20000000:00000080:2.0:1787432579.575982:0:6345:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff935b910d7c00 uarg=0000000000000000 20000000:01000000:2.0:1787432579.576018:0:6345:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787432579.576025:0:6345:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787432579.576030:0:6345:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787432579.576362:0:6345:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787432579.576376:0:6345:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787432579.581037:0:6345:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432579.581563:0:6345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787432579.581627:0:6345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787432579.581724:0:6345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787432579.581748:0:6345:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787432579.581767:0:6345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000468236d8/0xbcb9e331c3f0f826 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432579.581791:0:6345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005ccbbc6f/0xbcb9e331c3f0f7e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f7e0 expref: 11 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432579.581797:0:6345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000468236d8/0xbcb9e331c3f0f826 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432579.581837:0:6345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005ccbbc6f/0xbcb9e331c3f0f7e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f7e0 expref: 11 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432579.581853:0:6345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005ccbbc6f/0xbcb9e331c3f0f7e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f7e0 expref: 11 pid: 5862 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432579.581867:0:6345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d608807c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6345:1874258812735104:0@lo:104: 00000100:00100000:2.0:1787432579.581924:0:6345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432579.582031:0:6345:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f8daaf60 going to sleep for 11 seconds 00000100:00100000:3.0:1787432579.582492:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812735104 00000100:00100000:3.0:1787432579.582500:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812735104 00000100:00100000:3.0:1787432579.582553:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787432579.582569:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdcfe8c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+3:6345:x1874258812735104:12345-0@lo:104: 00010000:00010000:3.0:1787432579.582581:0:5850:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: 000000002c620040/0xbcb9e331c3f0f7e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f7e7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432579.582645:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787432579.582650:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdcfe8c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+3:6345:x1874258812735104:12345-0@lo:104: Request processed in 83us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432579.582681:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432579.582851:0:6345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d608807c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6345:1874258812735104:0@lo:104: 00010000:00010000:2.0:1787432579.582872:0:6345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000468236d8/0xbcb9e331c3f0f826 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432579.583169:0:5855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432579.583176:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: 000000002c620040/0xbcb9e331c3f0f7e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f7e7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432579.583184:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002c620040 already unused, calling callback (00000000abb2be14) 10000000:00010000:1.0:1787432579.583187:0:5855:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: 000000002c620040/0xbcb9e331c3f0f7e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f7e7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432579.585089:0:5855:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: 000000002c620040/0xbcb9e331c3f0f7e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f7e7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432579.585100:0:5855:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: 000000002c620040/0xbcb9e331c3f0f7e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f7e7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432579.585108:0:5855:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787432579.585174:0:5855:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: 000000002c620040/0xbcb9e331c3f0f7e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f7e7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432579.585181:0:5855:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432579.585332:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: 000000002c620040/0xbcb9e331c3f0f7e0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f7e7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432579.585341:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: 000000002c620040/0xbcb9e331c3f0f7e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f7e7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432579.585366:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432579.585367:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432579.585369:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432579.585476:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd840427 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812735232:0@lo:103: 00000100:00100000:2.0:1787432579.585557:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432579.585653:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812735232 00000100:00100000:1.0:1787432579.585682:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812735232 00010000:00010000:1.0:1787432579.585713:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005ccbbc6f/0xbcb9e331c3f0f7e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f7e0 expref: 12 pid: 5862 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432579.585749:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787432579.585758:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d608807c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:3333:x1874258812735232:12345-0@lo:103: 00010000:00010000:1.0:1787432579.585771:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432579.585775:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005ccbbc6f/0xbcb9e331c3f0f7e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f7e0 expref: 12 pid: 5862 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432579.585785:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005ccbbc6f/0xbcb9e331c3f0f7e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f7e0 expref: 12 pid: 5862 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432579.585798:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005ccbbc6f/0xbcb9e331c3f0f7e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f7e0 expref: 12 pid: 5862 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432579.585812:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000468236d8/0xbcb9e331c3f0f826 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432579.585826:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000468236d8/0xbcb9e331c3f0f826 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432579.585840:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000468236d8/0xbcb9e331c3f0f826 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432579.585847:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000468236d8/0xbcb9e331c3f0f826 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432579.585853:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000468236d8/0xbcb9e331c3f0f826 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432579.585859:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000468236d8/0xbcb9e331c3f0f826 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432579.585865:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000468236d8 already unused, calling callback (000000001273d40d) 00010000:00010000:1.0:1787432579.585868:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000468236d8/0xbcb9e331c3f0f826 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432579.585875:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000468236d8/0xbcb9e331c3f0f826 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432579.585888:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000468236d8/0xbcb9e331c3f0f826 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432579.585899:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432579.585932:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d608807c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:3333:x1874258812735232:12345-0@lo:103: Request processed in 176us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432579.585939:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787432579.586059:0:6345:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000468236d8/0xbcb9e331c3f0f826 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432579.586073:0:6345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000468236d8/0xbcb9e331c3f0f826 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432579.586078:0:6345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000468236d8/0xbcb9e331c3f0f826 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432579.587875:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd840427 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812735232:0@lo:103: 00010000:00010000:1.0:1787432580.217199:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432580.342802:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090bd8801 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812735360:0@lo:400: 00000100:00100000:3.0:1787432580.342919:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432580.343332:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432580.343360:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003063313c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874258812735488:0@lo:400: 00000100:00100000:1.0:1787432580.343387:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812735360 00000100:00100000:1.0:1787432580.343400:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812735360 00000100:00100000:3.0:1787432580.343530:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432580.343677:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812735488 00000100:00100000:0.0:1787432580.343684:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812735488 00000100:00100000:0.0:1787432580.343734:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432580.343743:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afe3d24c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874258812735488:12345-0@lo:400: 00000100:00100000:1.0:1787432580.343790:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787432580.343808:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afe3d24c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874258812735488:12345-0@lo:400: Request processed in 60us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432580.343809:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009db1a00d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:3330:x1874258812735360:12345-0@lo:400: 00000100:00100000:0.0:1787432580.343834:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787432580.343839:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003063313c x1874258812735488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432580.343858:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003063313c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874258812735488:0@lo:400: 00000100:00100000:3.0:1787432580.343906:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090bd8801 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812735360:0@lo:400: 00000100:00100000:1.0:1787432580.345734:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009db1a00d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:3330:x1874258812735360:12345-0@lo:400: Request processed in 1925us (2806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432580.345752:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787432581.237895:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432582.262424:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787432582.328794:0:5864:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787432582.328802:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff935b90e92000 from 1 10000000:01000000:3.0:1787432582.328807:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787432582.328850:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 00000000af5490fb/0xbcb9e331c3f0f82d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432582.328862:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 00000000af5490fb/0xbcb9e331c3f0f82d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432582.328873:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 00000000af5490fb/0xbcb9e331c3f0f82d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432582.328902:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055fad4ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812735616:0@lo:101: 00000100:00100000:3.0:1787432582.328970:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432582.329016:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set 0000000018394868 going to sleep for 11 seconds 00000100:00100000:3.0:1787432582.329038:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812735616 00000100:00100000:3.0:1787432582.329045:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812735616 00000100:00100000:3.0:1787432582.329096:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787432582.329104:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084b6f4ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:5864:x1874258812735616:12345-0@lo:101: 00010000:00010000:3.0:1787432582.329118:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432582.329128:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b9570f3c/0xbcb9e331c3f0f834 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f82d expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432582.329148:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b9570f3c/0xbcb9e331c3f0f834 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f82d expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432582.329157:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b9570f3c/0xbcb9e331c3f0f834 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f82d expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432582.329166:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b9570f3c, rc 0) 00000100:00100000:3.0:1787432582.329200:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084b6f4ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:5864:x1874258812735616:12345-0@lo:101: Request processed in 97us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432582.329207:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787432582.329268:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000055fad4ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812735616:0@lo:101: 00010000:00010000:3.0:1787432582.329281:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 00000000af5490fb/0xbcb9e331c3f0f82d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f834 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432582.329288:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 00000000af5490fb/0xbcb9e331c3f0f82d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f834 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432582.329350:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055fad4ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812735744:0@lo:501: 00000100:00100000:3.0:1787432582.329375:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432582.329389:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set 0000000018394868 going to sleep for 11 seconds 00000100:00100000:3.0:1787432582.329417:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812735744 00000100:00100000:3.0:1787432582.329420:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812735744 00000100:00100000:3.0:1787432582.329442:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787432582.329447:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002278e18b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:5864:x1874258812735744:12345-0@lo:501: 00000100:00100000:3.0:1787432582.329728:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002278e18b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:5864:x1874258812735744:12345-0@lo:501: Request processed in 280us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432582.329735:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787432582.329767:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000055fad4ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812735744:0@lo:501: 00000100:00100000:3.0:1787432582.329793:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055fad4ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812735872:0@lo:503: 00000100:00100000:3.0:1787432582.329830:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432582.329843:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set 0000000018394868 going to sleep for 11 seconds 00000100:00100000:3.0:1787432582.329855:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812735872 00000100:00100000:3.0:1787432582.329859:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812735872 00000100:00100000:3.0:1787432582.329881:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787432582.329887:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c4ce19f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:5864:x1874258812735872:12345-0@lo:503: 00000100:00100000:3.0:1787432582.330036:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c4ce19f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:5864:x1874258812735872:12345-0@lo:503: Request processed in 149us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432582.330043:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787432582.330083:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000055fad4ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812735872:0@lo:503: 00000100:00100000:1.0:1787432582.340144:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a623b640 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6477:1874258812736000:0@lo:502: 00000100:00100000:1.0:1787432582.340237:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432582.340292:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set 0000000095106581 going to sleep for 11 seconds 00000100:00100000:3.0:1787432582.340473:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812736000 00000100:00100000:3.0:1787432582.340480:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812736000 00000100:00100000:3.0:1787432582.340537:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787432582.340545:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024944d4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:6477:x1874258812736000:12345-0@lo:502: 00000100:00100000:3.0:1787432582.340814:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024944d4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:6477:x1874258812736000:12345-0@lo:502: Request processed in 269us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432582.340821:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787432582.341112:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a623b640 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6477:1874258812736000:0@lo:502: 00000020:01000000:1.0:1787432582.341141:0:6477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432582.341150:0:6477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432582.341152:0:6477:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787432582.341159:0:6477:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff935b90e92000 00000020:00000080:1.0:1787432582.341162:0:6477:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787432582.341203:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6477:1874258812736128:0@lo:502: 00000100:00100000:1.0:1787432582.341239:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432582.341276:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba2af60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432582.341329:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812736128 00000100:00100000:3.0:1787432582.341334:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812736128 00000100:00100000:3.0:1787432582.341360:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787432582.341367:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:6477:x1874258812736128:12345-0@lo:502: 00000100:00100000:3.0:1787432582.341516:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:6477:x1874258812736128:12345-0@lo:502: Request processed in 149us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432582.341524:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787432582.341602:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6477:1874258812736128:0@lo:502: 00000020:01000000:1.0:1787432582.341620:0:6477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432582.341624:0:6477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432582.341626:0:6477:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787432582.341630:0:6477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787432582.341722:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787432582.341740:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787432582.341750:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f0f82d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f834 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432582.341761:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f0f82d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f834 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432583.288002:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432584.312846:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432585.342102:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432585.469223:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812736256:0@lo:400: 00000100:00100000:1.0:1787432585.469383:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432585.469541:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812736256 00000100:00100000:3.0:1787432585.469551:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812736256 00000100:00100000:3.0:1787432585.469611:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787432585.469621:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:3332:x1874258812736256:12345-0@lo:400: 00000100:00100000:2.0:1787432585.469811:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812736384:0@lo:400: 00000100:00100000:2.0:1787432585.469857:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432585.469893:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812736384 00000100:00100000:2.0:1787432585.469896:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812736384 00000100:00100000:2.0:1787432585.469921:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432585.469937:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812736384:12345-0@lo:400: 00000100:00100000:2.0:1787432585.469972:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812736384:12345-0@lo:400: Request processed in 36us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432585.469979:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787432585.470030:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff935bba0aaa00 x1874258812736384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432585.470043:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812736384:0@lo:400: 00000100:00100000:3.0:1787432585.470259:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:3332:x1874258812736256:12345-0@lo:400: Request processed in 627us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432585.470266:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787432585.474405:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812736256:0@lo:400: 00000020:01000004:1.0:1787432586.278296:0:6721:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787432586.278300:0:6721:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787432586.278493:0:6721:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff935bbb3e4800 00000020:01000004:1.0:1787432586.278513:0:6721:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787432586.278527:0:6721:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787432586.278553:0:6721:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff935b9078cd28) 00000020:00000080:1.0:1787432586.278574:0:6721:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787432586.303283:0:6721:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787432586.303697:0:6721:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787432586.331434:0:6721:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787432586.339263:0:6721:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787432586.340057:0:6721:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787432586.340123:0:6721:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787432586.340151:0:6721:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787432586.340813:0:6721:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787432586.340825:0:6721:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787432586.340837:0:6721:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbcb9e331c3f0f842 00000020:01000004:2.0:1787432586.340860:0:6721:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787432586.340883:0:6721:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.115@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787432586.340886:0:6721:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787432586.340892:0:6721:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787432586.340896:0:6721:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787432586.340907:0:6721:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff935b90628000) 00000020:00000080:2.0:1787432586.340918:0:6721:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787432586.344006:0:6721:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787432586.344197:0:6721:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787432586.344205:0:6721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787432586.345444:0:6721:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787432586.345462:0:6721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787432586.346024:0:6721:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787432586.346032:0:6721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787432586.356151:0:6721:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787432586.356363:0:6721:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787432586.356371:0:6721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00010000:00010000:1.0:1787432586.359458:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432586.359781:0:6721:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787432586.359792:0:6721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787432586.427795:0:6721:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432586.429070:0:6721:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787432586.429081:0:6721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787432586.433279:0:6721:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787432586.433304:0:6721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787432586.437412:0:6721:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787432586.437432:0:6721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787432586.463564:0:6721:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787432586.463819:0:6721:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787432586.463831:0:6721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787432586.469357:0:6721:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787432586.469438:0:6721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787432586.566006:0:6721:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432586.567645:0:6721:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787432586.567669:0:6721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787432586.569089:0:6721:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787432586.569101:0:6721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787432586.569706:0:6721:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787432586.569732:0:6721:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787432586.569738:0:6721:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.115@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787432586.606208:0:6721:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787432586.606253:0:6721:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.115@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787432586.606257:0:6721:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787432586.606258:0:6721:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787432586.606259:0:6721:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787432586.606261:0:6721:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787432586.606262:0:6721:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787432586.606263:0:6721:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787432586.606265:0:6721:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787432586.606266:0:6721:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787432586.606267:0:6721:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787432586.606269:0:6721:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787432586.606271:0:6721:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787432586.606274:0:6721:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787432586.606280:0:6721:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787432586.606281:0:6721:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787432586.606283:0:6721:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787432586.606284:0:6721:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787432586.606285:0:6721:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787432586.606286:0:6721:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787432586.606287:0:6721:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787432586.606288:0:6721:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787432586.606289:0:6721:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787432586.606290:0:6721:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787432586.606291:0:6721:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787432586.606329:0:6721:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787432586.606349:0:6721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812736512:0@lo:253: 00000100:00100000:0.0:1787432586.607177:0:6721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432586.607378:0:6721:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91a233c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432586.607568:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812736512 00000100:00100000:3.0:1787432586.607579:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812736512 00000100:00100000:3.0:1787432586.607823:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787432586.607835:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87906850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:6721:x1874258812736512:12345-0@lo:253: 20000000:01000000:3.0:1787432586.607921:0:5861:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787432586.607925:0:5861:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1787432586.607932:0:5861:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1787432586.607936:0:5861:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1787432586.609023:0:5861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787432586.609248:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1787432586.609262:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1787432586.609302:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1787432586.609310:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1787432586.609344:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1787432586.609406:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1787432586.609868:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1787432586.609893:0:5861:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.115@tcp 20000000:01000000:3.0:1787432586.609896:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.115@tcp (null) (null) (null) 00000040:00080000:3.0:1787432586.609935:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1787432586.609944:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787432586.609994:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1787432586.610003:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.115@tcp (null) (null) 00000040:00080000:3.0:1787432586.610037:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1787432586.610047:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787432586.610081:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1787432586.610134:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1787432586.610935:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1787432586.610964:0:5861:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.115@tcp 20000000:01000000:3.0:1787432586.610966:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.115@tcp (null) (null) (null) 00000040:00080000:3.0:1787432586.611005:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787432586.611014:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787432586.611064:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787432586.611073:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.115@tcp (null) (null) 00000040:00080000:3.0:1787432586.611122:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787432586.611132:0:5861:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787432586.611167:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1787432586.611206:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1787432586.611224:0:5861:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787432586.611226:0:5861:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787432586.611230:0:5861:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787432586.611241:0:5861:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787432586.611244:0:5861:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787432586.611276:0:5861:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787432586.611279:0:5861:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787432586.612313:0:6736:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787432586.612406:0:6736:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787432586.612492:0:6736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787432586.613073:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787432586.613127:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787432586.613210:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787432586.613228:0:5861:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787432586.613230:0:5861:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787432586.617398:0:6737:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787432586.617506:0:6737:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787432586.617553:0:6737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787432586.618081:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787432586.618136:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787432586.618177:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787432586.618202:0:5861:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787432586.618205:0:5861:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787432586.619773:0:6738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1787432586.620242:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1787432586.620293:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1787432586.620777:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1787432586.620804:0:5861:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787432586.620807:0:5861:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787432586.620820:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787432586.620854:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f850 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432586.620877:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935b80031200/0xbcb9e331c3f0f769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f762 expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432586.620885:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935b80031a00/0xbcb9e331c3f0f785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f77e expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432586.620891:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bc2155c00/0xbcb9e331c3f0f7f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f7ee expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432586.620897:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f850 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432586.620950:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bc2155c00/0xbcb9e331c3f0f7f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f7ee expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432586.620965:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bc2155c00/0xbcb9e331c3f0f7f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f7ee expref: 12 pid: 5862 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432586.620980:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9524e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5861:1874258812736640:0@lo:104: 00000100:00100000:2.0:1787432586.621276:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432586.621343:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935b80031a00/0xbcb9e331c3f0f785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f77e expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432586.621489:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935b80031a00/0xbcb9e331c3f0f785 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f77e expref: 12 pid: 5862 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432586.621499:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9525500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5861:1874258812736768:0@lo:104: 00000100:00100000:2.0:1787432586.621523:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432586.621558:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935b80031200/0xbcb9e331c3f0f769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f762 expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432586.621565:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935b80031200/0xbcb9e331c3f0f769 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f762 expref: 12 pid: 5860 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432586.621572:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9525c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5861:1874258812736896:0@lo:104: 00000100:00100000:2.0:1787432586.621591:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432586.621601:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba051d240 going to sleep for 11 seconds 00000100:00100000:1.0:1787432586.621726:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812736640 00000100:00100000:1.0:1787432586.621735:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812736640 00000100:00100000:1.0:1787432586.621777:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812736768 00000100:00100000:1.0:1787432586.621780:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812736768 00000100:00100000:1.0:1787432586.621790:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812736896 00000100:00100000:1.0:1787432586.621793:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812736896 00000100:00100000:1.0:1787432586.621806:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432586.621814:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9526680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+5:5861:x1874258812736640:12345-0@lo:104: 00010000:00010000:1.0:1787432586.621826:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f0f7ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f7f5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.623279:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787432586.623296:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9526680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+5:5861:x1874258812736640:12345-0@lo:104: Request processed in 1479us (2016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432586.623310:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432586.623364:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787432586.623377:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9527b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+4:5861:x1874258812736768:12345-0@lo:104: 00010000:00010000:1.0:1787432586.623407:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bc2167e00/0xbcb9e331c3f0f77e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f785 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.623768:0:5855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787432586.623776:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f0f7ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f7f5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.623785:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031c00 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:0.0:1787432586.623790:0:5855:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f0f7ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f7f5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.623800:0:5855:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f0f7ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f7f5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432586.623808:0:5855:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f0f7ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f7f5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432586.623823:0:5855:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432586.623882:0:5855:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f0f7ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f7f5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.623889:0:5855:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432586.623916:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f0f7ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f7f5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.623924:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f0f7ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f7f5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.623946:0:5855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432586.623950:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bc2167e00/0xbcb9e331c3f0f77e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f785 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.623955:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2167e00 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:0.0:1787432586.623957:0:5855:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bc2167e00/0xbcb9e331c3f0f77e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f785 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.623963:0:5855:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bc2167e00/0xbcb9e331c3f0f77e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f785 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432586.623969:0:5855:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bc2167e00/0xbcb9e331c3f0f77e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f785 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432586.623974:0:5855:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432586.623986:0:5855:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bc2167e00/0xbcb9e331c3f0f77e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f785 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.623991:0:5855:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432586.624002:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bc2167e00/0xbcb9e331c3f0f77e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f785 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.624008:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bc2167e00/0xbcb9e331c3f0f77e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f785 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.624031:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432586.624033:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432586.624035:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432586.624061:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812737152:0@lo:103: 00000100:00100000:0.0:1787432586.624108:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432586.624161:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432586.624168:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812737024:0@lo:103: 00000100:00100000:0.0:1787432586.624188:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432586.624829:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9524e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5861:1874258812736640:0@lo:104: 00000100:00100000:0.0:1787432586.625515:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9525500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5861:1874258812736768:0@lo:104: 00010000:00010000:1.0:1787432586.625647:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1787432586.625669:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9527b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+4:5861:x1874258812736768:12345-0@lo:104: Request processed in 2285us (4134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432586.625680:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787432586.625718:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787432586.625731:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9524380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+3:5861:x1874258812736896:12345-0@lo:104: 00010000:00010000:1.0:1787432586.625745:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f769 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432586.625884:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9525c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5861:1874258812736896:0@lo:104: 00010000:00010000:2.0:1787432586.625920:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f850 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.626286:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432586.626293:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f769 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.626301:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bb5210400 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:0.0:1787432586.626306:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f769 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.626314:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f769 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432586.626321:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f769 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432586.626346:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432586.626520:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f762 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f769 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.626528:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432586.626554:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f762 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f769 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.626562:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f762 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f769 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.626581:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432586.626583:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432586.626584:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432586.626649:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432586.626692:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812737280:0@lo:103: 00000100:00100000:2.0:1787432586.626736:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432586.627190:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812737152 00000100:00100000:0.0:1787432586.627199:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812737152 00010000:00010000:0.0:1787432586.627230:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935b80031a00/0xbcb9e331c3f0f785 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f77e expref: 13 pid: 5862 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432586.627249:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812737024 00000100:00100000:0.0:1787432586.627253:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812737024 00010000:00010000:0.0:1787432586.627265:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bc2155c00/0xbcb9e331c3f0f7f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f7ee expref: 14 pid: 5862 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432586.627275:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812737280 00000100:00100000:0.0:1787432586.627277:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812737280 00010000:00010000:0.0:1787432586.627286:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935b80031200/0xbcb9e331c3f0f769 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f762 expref: 15 pid: 5860 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432586.627299:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432586.627306:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:3331:x1874258812737152:12345-0@lo:103: 00010000:00010000:0.0:1787432586.627346:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432586.627489:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935b80031a00/0xbcb9e331c3f0f785 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f77e expref: 15 pid: 5862 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.627499:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935b80031a00/0xbcb9e331c3f0f785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f77e expref: 15 pid: 5862 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.627513:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935b80031a00/0xbcb9e331c3f0f785 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f77e expref: 15 pid: 5862 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.627530:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432586.627636:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:3331:x1874258812737152:12345-0@lo:103: Request processed in 329us (3527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432586.627644:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432586.627679:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432586.627685:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:3331:x1874258812737024:12345-0@lo:103: 00010000:00010000:0.0:1787432586.627694:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432586.627699:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bc2155c00/0xbcb9e331c3f0f7f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f7ee expref: 13 pid: 5862 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.627707:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bc2155c00/0xbcb9e331c3f0f7f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f7ee expref: 13 pid: 5862 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.627717:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bc2155c00/0xbcb9e331c3f0f7f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f7ee expref: 13 pid: 5862 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.627725:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432586.627747:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:3331:x1874258812737024:12345-0@lo:103: Request processed in 62us (3558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432586.627753:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432586.627773:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432586.627779:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:3333:x1874258812737280:12345-0@lo:103: 00010000:00010000:0.0:1787432586.627787:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432586.627791:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935b80031200/0xbcb9e331c3f0f769 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f762 expref: 11 pid: 5860 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.627800:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935b80031200/0xbcb9e331c3f0f769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f762 expref: 11 pid: 5860 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.627810:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935b80031200/0xbcb9e331c3f0f769 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f762 expref: 11 pid: 5860 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.627823:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f850 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.627831:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f850 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.627862:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f850 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.627870:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f850 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.627876:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f850 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.627882:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f850 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.627887:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bb5210600 already unused, calling callback (ffffffffc1752230) 00010000:00010000:0.0:1787432586.627891:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f850 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.627914:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f850 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.627938:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f850 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.627948:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432586.627978:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+10:3333:x1874258812737280:12345-0@lo:103: Request processed in 198us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432586.627984:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787432586.628327:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1787432586.628337:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9524380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+3:5861:x1874258812736896:12345-0@lo:104: Request processed in 2609us (6743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432586.628344:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787432586.628555:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f850 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.628564:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f850 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.628570:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f850 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787432586.628588:0:5861:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787432586.628645:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812737280:0@lo:103: 00010000:00010000:0.0:1787432586.632216:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432586.639573:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812737152:0@lo:103: 00000100:00100000:2.0:1787432586.642780:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812737024:0@lo:103: 00000100:00100000:3.0:1787432586.696795:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87906850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+9:6721:x1874258812736512:12345-0@lo:253: Request processed in 88952us (89610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432586.696810:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787432586.696980:0:6721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812736512:0@lo:253: 10000000:01000000:2.0:1787432586.697003:0:6721:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787432586.697006:0:6721:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787432586.697007:0:6721:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787432586.697009:0:6721:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432586.697010:0:6721:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787432586.697011:0:6721:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432586.697012:0:6721:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432586.697014:0:6721:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787432586.697185:0:6721:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787432586.697187:0:6721:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432586.697189:0:6721:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787432586.697213:0:6721:0:(tgt_mount.c:101:server_register_mount()) register mount ffff935bbb3e4800 from lustre-OST0000 10000000:01000000:2.0:1787432586.697242:0:6721:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787432586.697244:0:6721:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787432586.697252:0:6721:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff935b879b0000 local copy 10000000:01000000:2.0:1787432586.697256:0:6721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787432586.697302:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bb5211600/0xbcb9e331c3f0f857 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432586.697315:0:6721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.115@tcp lock: ffff935bb5211600/0xbcb9e331c3f0f857 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432586.697326:0:6721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bb5211600/0xbcb9e331c3f0f857 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432586.697473:0:6721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9525500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812737408:0@lo:101: 00000100:00100000:2.0:1787432586.697520:0:6721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432586.697575:0:6721:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91f45480 going to sleep for 11 seconds 00000100:00100000:3.0:1787432586.697688:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812737408 00000100:00100000:3.0:1787432586.697696:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812737408 00000100:00100000:3.0:1787432586.697741:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787432586.697751:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+9:6721:x1874258812737408:12345-0@lo:101: 00010000:00010000:3.0:1787432586.697767:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432586.697782:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bc2155600/0xbcb9e331c3f0f85e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f857 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.697811:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bc2155600/0xbcb9e331c3f0f85e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f857 expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.697822:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bc2155600/0xbcb9e331c3f0f85e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f857 expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.697831:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155600, rc 0) 00000100:00100000:3.0:1787432586.697873:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+10:6721:x1874258812737408:12345-0@lo:101: Request processed in 124us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432586.697880:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787432586.698008:0:6721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9525500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812737408:0@lo:101: 00010000:00010000:1.0:1787432586.698034:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bb5211600/0xbcb9e331c3f0f857 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbcb9e331c3f0f85e expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.698043:0:6721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bb5211600/0xbcb9e331c3f0f857 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbcb9e331c3f0f85e expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432586.698215:0:6721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812737536:0@lo:501: 00000100:00100000:1.0:1787432586.698244:0:6721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432586.698613:0:6721:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87dc29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432586.698772:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812737536 00000100:00100000:2.0:1787432586.698778:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812737536 00000100:00100000:2.0:1787432586.698817:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787432586.698826:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+10:6721:x1874258812737536:12345-0@lo:501: 00000100:00100000:2.0:1787432586.699330:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+10:6721:x1874258812737536:12345-0@lo:501: Request processed in 503us (1083us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787432586.699340:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787432586.699597:0:6721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812737536:0@lo:501: 10000000:01000000:1.0:1787432586.699628:0:6721:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787432586.699684:0:6721:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787432586.699691:0:6721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bb5211600/0xbcb9e331c3f0f857 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbcb9e331c3f0f85e expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.699700:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bb5211600/0xbcb9e331c3f0f857 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbcb9e331c3f0f85e expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.699707:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff935bb5211600/0xbcb9e331c3f0f857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbcb9e331c3f0f85e expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.699732:0:6721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787432586.699762:0:6721:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff935bbb3e4800 10000000:01000000:1.0:1787432586.699767:0:6721:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787432586.699773:0:6721:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff935b879b0000 10000000:01000000:1.0:1787432586.699776:0:6721:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787432586.699779:0:6721:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff935b879b0000 from 1 10000000:01000000:1.0:1787432586.699783:0:6721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787432586.699816:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2167e00/0xbcb9e331c3f0f865 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.699822:0:6721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bc2167e00/0xbcb9e331c3f0f865 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.699830:0:6721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bc2167e00/0xbcb9e331c3f0f865 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432586.699847:0:6721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812737664:0@lo:101: 00000100:00100000:1.0:1787432586.699879:0:6721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787432586.699995:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432586.700003:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bb5211600/0xbcb9e331c3f0f857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xbcb9e331c3f0f85e expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.700012:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bb5211600 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:0.0:1787432586.700023:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bb5211600/0xbcb9e331c3f0f857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xbcb9e331c3f0f85e expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.700032:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bb5211600/0xbcb9e331c3f0f857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xbcb9e331c3f0f85e expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432586.700041:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bb5211600/0xbcb9e331c3f0f857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xbcb9e331c3f0f85e expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432586.700047:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432586.700072:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bb5211600/0xbcb9e331c3f0f857 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbcb9e331c3f0f85e expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.700077:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432586.700100:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bb5211600/0xbcb9e331c3f0f857 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbcb9e331c3f0f85e expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.700107:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bb5211600/0xbcb9e331c3f0f857 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbcb9e331c3f0f85e expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.700123:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432586.700125:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432586.700127:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432586.700269:0:6721:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87dc2240 going to sleep for 11 seconds 00000100:00100000:1.0:1787432586.700286:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432586.700296:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812737792:0@lo:103: 00000100:00100000:1.0:1787432586.700324:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432586.700517:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812737664 00000100:00100000:2.0:1787432586.700524:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812737664 00000100:00100000:2.0:1787432586.700570:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787432586.700579:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+10:6721:x1874258812737664:12345-0@lo:101: 00010000:00010000:2.0:1787432586.700589:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432586.700604:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bb5210a00/0xbcb9e331c3f0f86c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f865 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432586.700628:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bb5210a00/0xbcb9e331c3f0f86c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f865 expref: 11 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432586.700640:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bb5210a00/0xbcb9e331c3f0f86c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f865 expref: 11 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432586.700650:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bb5210a00, rc 0) 00000100:00100000:2.0:1787432586.700713:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:6721:x1874258812737664:12345-0@lo:101: Request processed in 136us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432586.700719:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787432586.700828:0:6721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812737664:0@lo:101: 00010000:00010000:1.0:1787432586.700842:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bc2167e00/0xbcb9e331c3f0f865 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f86c expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.700850:0:6721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bc2167e00/0xbcb9e331c3f0f865 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f86c expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432586.700865:0:6721:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787432586.700881:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2167e00/0xbcb9e331c3f0f865 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f86c expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.700888:0:6721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bc2167e00/0xbcb9e331c3f0f865 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f86c expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432586.700894:0:6721:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787432586.700897:0:6721:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787432586.700977:0:6721:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787432586.700981:0:6721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787432586.700998:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f873 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.701005:0:6721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f873 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.701012:0:6721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f873 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432586.701156:0:6721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812737920:0@lo:101: 00000100:00100000:1.0:1787432586.701184:0:6721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432586.701201:0:6721:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87dc2240 going to sleep for 11 seconds 00000100:00100000:0.0:1787432586.701288:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812737792 00000100:00100000:0.0:1787432586.701293:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812737792 00000100:00100000:0.0:1787432586.701338:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432586.701346:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9557800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:3332:x1874258812737792:12345-0@lo:103: 00010000:00010000:0.0:1787432586.701474:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432586.701488:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bc2155600/0xbcb9e331c3f0f85e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbcb9e331c3f0f857 expref: 11 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.701503:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432586.701533:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9557800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+10:3332:x1874258812737792:12345-0@lo:103: Request processed in 188us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432586.701540:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787432586.701605:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812737920 00000100:00100000:2.0:1787432586.701609:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812737920 00000100:00100000:2.0:1787432586.701638:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787432586.701643:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+10:6721:x1874258812737920:12345-0@lo:101: 00010000:00010000:2.0:1787432586.701650:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432586.701678:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0f87a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f873 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432586.701703:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0f87a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f873 expref: 11 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432586.701712:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0f87a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f873 expref: 11 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432586.701718:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bb5210200, rc 0) 00000100:00100000:2.0:1787432586.701744:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:6721:x1874258812737920:12345-0@lo:101: Request processed in 101us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432586.701749:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787432586.701848:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812737792:0@lo:103: 00000100:00100000:1.0:1787432586.701877:0:6721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812737920:0@lo:101: 00010000:00010000:1.0:1787432586.701888:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f873 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f87a expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.701897:0:6721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f873 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f87a expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432586.702187:0:6721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812738048:0@lo:501: 00000100:00100000:1.0:1787432586.702215:0:6721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432586.702245:0:6721:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87dc2240 going to sleep for 11 seconds 00000100:00100000:0.0:1787432586.702314:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812738048 00000100:00100000:0.0:1787432586.702319:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812738048 00000100:00100000:0.0:1787432586.702340:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787432586.702347:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:6721:x1874258812738048:12345-0@lo:501: 00000100:00100000:0.0:1787432586.702818:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:6721:x1874258812738048:12345-0@lo:501: Request processed in 470us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432586.702825:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787432586.703185:0:6721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812738048:0@lo:501: 00000100:00100000:1.0:1787432586.703227:0:6721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812738176:0@lo:503: 00000100:00100000:1.0:1787432586.703270:0:6721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432586.703303:0:6721:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87dc2240 going to sleep for 11 seconds 00000100:00100000:3.0:1787432586.703520:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812738176 00000100:00100000:3.0:1787432586.703527:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812738176 00000100:00100000:3.0:1787432586.703586:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787432586.703595:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:6721:x1874258812738176:12345-0@lo:503: 00000100:00100000:3.0:1787432586.703798:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:6721:x1874258812738176:12345-0@lo:503: Request processed in 204us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432586.703806:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787432586.703991:0:6721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812738176:0@lo:503: 00000040:00080000:1.0:1787432586.705207:0:6721:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787432586.705550:0:6721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812738304:0@lo:502: 00000100:00100000:1.0:1787432586.705626:0:6721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432586.705769:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812738304 00000100:00100000:3.0:1787432586.705778:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812738304 00000100:00100000:3.0:1787432586.705841:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787432586.705849:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:6721:x1874258812738304:12345-0@lo:502: 00000100:00100000:1.0:1787432586.706501:0:6721:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87dc2240 going to sleep for 11 seconds 00000100:00100000:3.0:1787432586.707168:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:6721:x1874258812738304:12345-0@lo:502: Request processed in 1317us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432586.707178:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787432586.707299:0:6721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812738304:0@lo:502: 00000040:00080000:1.0:1787432586.707813:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787432586.707871:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787432586.707969:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787432586.708136:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787432586.708174:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787432586.708205:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787432586.708343:0:6721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812738432:0@lo:502: 00000100:00100000:1.0:1787432586.708536:0:6721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432586.708766:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812738432 00000100:00100000:2.0:1787432586.708773:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812738432 00000100:00100000:2.0:1787432586.708825:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787432586.708836:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:6721:x1874258812738432:12345-0@lo:502: 00000100:00100000:1.0:1787432586.709009:0:6721:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87dc2240 going to sleep for 11 seconds 00000100:00100000:2.0:1787432586.709646:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:6721:x1874258812738432:12345-0@lo:502: Request processed in 809us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432586.709786:0:6721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812738432:0@lo:502: 00000100:00100000:2.0:1787432586.710004:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000040:00080000:1.0:1787432586.710306:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787432586.710330:0:6721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1787432586.711539:0:6739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787432586.711551:0:6739:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787432586.711560:0:6739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432586.711563:0:6739:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787432586.711570:0:6739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787432586.711618:0:6739:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff935bbae7b370) 00000020:00000080:2.0:1787432586.711647:0:6739:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787432586.711702:0:6739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787432586.711805:0:6739:0:(tgt_mount.c:153:server_get_mount()) get mount ffff935bbb3e4800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787432586.711814:0:6739:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787432586.711823:0:6739:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbcb9e331c3f0f888 00010000:00010000:2.0:1787432586.722588:0:6739:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1787432586.723185:0:6739:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787432586.726702:0:6739:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787432586.727065:0:6739:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787432586.746811:0:6739:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787432586.747503:0:6739:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787432586.749727:0:6739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787432586.749742:0:6739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432586.749751:0:6739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432586.749753:0:6739:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787432586.749759:0:6739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432586.749763:0:6739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432586.749765:0:6739:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787432586.749768:0:6739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787432586.749770:0:6739:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787432586.749833:0:6739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432586.749836:0:6739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432586.749838:0:6739:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787432586.749841:0:6739:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787432586.752685:0:6721:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787432586.752748:0:6721:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787432586.752769:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f873 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f87a expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.752785:0:6721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f87a expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432586.752794:0:6721:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff935bbb3e4800 from 1 10000000:01000000:3.0:1787432586.752797:0:6721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787432586.752851:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2154000/0xbcb9e331c3f0f88f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.752859:0:6721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bc2154000/0xbcb9e331c3f0f88f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.752874:0:6721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bc2154000/0xbcb9e331c3f0f88f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432586.754570:0:6721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86833480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812738560:0@lo:101: 00000100:00100000:3.0:1787432586.754649:0:6721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432586.754860:0:6721:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba0788780 going to sleep for 11 seconds 00000100:00100000:1.0:1787432586.756249:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812738560 00000100:00100000:1.0:1787432586.756264:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812738560 00000100:00100000:1.0:1787432586.757671:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787432586.757693:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:6721:x1874258812738560:12345-0@lo:101: 00010000:00010000:1.0:1787432586.757714:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432586.757734:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bc2166000/0xbcb9e331c3f0f896 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f88f expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.757764:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bc2166000/0xbcb9e331c3f0f896 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f88f expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.757775:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bc2166000/0xbcb9e331c3f0f896 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f88f expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.757785:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2166000, rc 0) 00000100:00100000:1.0:1787432586.757867:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:6721:x1874258812738560:12345-0@lo:101: Request processed in 182us (3216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432586.757881:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787432586.759903:0:6721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86833480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812738560:0@lo:101: 00010000:00010000:0.0:1787432586.759929:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bc2154000/0xbcb9e331c3f0f88f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f896 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.759941:0:6721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bc2154000/0xbcb9e331c3f0f88f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f896 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432586.760069:0:6721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812738688:0@lo:501: 00000100:00100000:0.0:1787432586.760124:0:6721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432586.760422:0:6721:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91a236c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432586.760485:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812738688 00000100:00100000:2.0:1787432586.760491:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812738688 00000100:00100000:2.0:1787432586.760528:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787432586.760536:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:6721:x1874258812738688:12345-0@lo:501: 00000100:00100000:0.0:1787432586.760964:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:6721:x1874258812738688:12345-0@lo:501: Request processed in 427us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432586.760973:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787432586.761112:0:6721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812738688:0@lo:501: 00000100:00100000:3.0:1787432586.761148:0:6721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86833800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812738816:0@lo:503: 00000100:00100000:3.0:1787432586.761184:0:6721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432586.761217:0:6721:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91679cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432586.761256:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812738816 00000100:00100000:2.0:1787432586.761260:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812738816 00000100:00100000:2.0:1787432586.761289:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787432586.761295:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:6721:x1874258812738816:12345-0@lo:503: 00000100:00100000:2.0:1787432586.761533:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:6721:x1874258812738816:12345-0@lo:503: Request processed in 237us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432586.761542:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787432586.761611:0:6721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86833800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812738816:0@lo:503: 00000040:00080000:3.0:1787432586.761888:0:6721:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787432586.761956:0:6721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86833800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812738944:0@lo:502: 00000100:00100000:3.0:1787432586.761989:0:6721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432586.762004:0:6721:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91679cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432586.762115:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812738944 00000100:00100000:2.0:1787432586.762119:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812738944 00000100:00100000:2.0:1787432586.762139:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787432586.762144:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:6721:x1874258812738944:12345-0@lo:502: 00000100:00100000:2.0:1787432586.762299:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:6721:x1874258812738944:12345-0@lo:502: Request processed in 155us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432586.762307:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787432586.762374:0:6721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86833800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812738944:0@lo:502: 00000040:00080000:3.0:1787432586.762650:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787432586.762732:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787432586.762758:0:6721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86833800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812739072:0@lo:502: 00000100:00100000:3.0:1787432586.762793:0:6721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432586.762812:0:6721:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91679cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432586.762870:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812739072 00000100:00100000:2.0:1787432586.762875:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812739072 00000100:00100000:2.0:1787432586.762896:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787432586.762914:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:6721:x1874258812739072:12345-0@lo:502: 00000100:00100000:2.0:1787432586.763041:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:6721:x1874258812739072:12345-0@lo:502: Request processed in 128us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432586.763058:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787432586.763200:0:6721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86833800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812739072:0@lo:502: 00000040:00080000:3.0:1787432586.763305:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787432586.763316:0:6721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787432586.763999:0:6743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432586.764009:0:6743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432586.764012:0:6743:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787432586.764019:0:6743:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff935bbb3e4800 00000020:00000080:3.0:1787432586.764021:0:6743:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787432586.764039:0:6743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432586.764042:0:6743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432586.764043:0:6743:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787432586.764046:0:6743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787432586.764371:0:6721:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787432586.764397:0:6721:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787432586.764457:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2154000/0xbcb9e331c3f0f88f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f896 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.764477:0:6721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bc2154000/0xbcb9e331c3f0f88f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f896 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432586.764539:0:6721:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787432586.764543:0:6721:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff935bbb3e4800 10000000:01000000:0.0:1787432586.764546:0:6721:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff935bbb3e4800 10000000:01000000:0.0:1787432586.764550:0:6721:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787432586.764556:0:6721:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff935bbb3e4800 from 1 10000000:01000000:0.0:1787432586.764559:0:6721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787432586.764593:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0f89d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.764603:0:6721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0f89d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.764614:0:6721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0f89d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432586.764633:0:6721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812739200:0@lo:101: 00000100:00100000:0.0:1787432586.764721:0:6721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432586.764756:0:6721:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91a23600 going to sleep for 11 seconds 00000100:00100000:3.0:1787432586.764808:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812739200 00000100:00100000:3.0:1787432586.764814:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812739200 00000100:00100000:3.0:1787432586.764851:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787432586.764859:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:6721:x1874258812739200:12345-0@lo:101: 00010000:00010000:3.0:1787432586.764878:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432586.764891:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bc2155600/0xbcb9e331c3f0f8a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f89d expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.764923:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bc2155600/0xbcb9e331c3f0f8a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f89d expref: 13 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.764933:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bc2155600/0xbcb9e331c3f0f8a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f89d expref: 13 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.764942:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155600, rc 0) 00000100:00100000:3.0:1787432586.764978:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:6721:x1874258812739200:12345-0@lo:101: Request processed in 119us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432586.764984:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787432586.765170:0:6721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812739200:0@lo:101: 00010000:00010000:1.0:1787432586.765184:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0f89d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f8a4 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.765193:0:6721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0f89d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f8a4 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432586.765291:0:6721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812739328:0@lo:501: 00000100:00100000:1.0:1787432586.765320:0:6721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432586.765346:0:6721:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87dc2300 going to sleep for 11 seconds 00000100:00100000:0.0:1787432586.765436:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812739328 00000100:00100000:0.0:1787432586.765450:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812739328 00000100:00100000:0.0:1787432586.765484:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787432586.765491:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:6721:x1874258812739328:12345-0@lo:501: 00000100:00100000:0.0:1787432586.765724:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:6721:x1874258812739328:12345-0@lo:501: Request processed in 232us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432586.765731:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787432586.765838:0:6721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812739328:0@lo:501: 00000100:00100000:1.0:1787432586.765865:0:6721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812739456:0@lo:503: 00000100:00100000:1.0:1787432586.765896:0:6721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432586.765988:0:6721:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87dc2300 going to sleep for 11 seconds 00000100:00100000:0.0:1787432586.766028:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812739456 00000100:00100000:0.0:1787432586.766032:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812739456 00000100:00100000:0.0:1787432586.766059:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787432586.766065:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:6721:x1874258812739456:12345-0@lo:503: 00000100:00100000:0.0:1787432586.766288:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:6721:x1874258812739456:12345-0@lo:503: Request processed in 222us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432586.766295:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787432586.766426:0:6721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812739456:0@lo:503: 00000040:00080000:1.0:1787432586.766887:0:6721:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787432586.767012:0:6721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812739584:0@lo:502: 00000100:00100000:1.0:1787432586.767048:0:6721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432586.767110:0:6721:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87dc2300 going to sleep for 11 seconds 00000100:00100000:3.0:1787432586.767239:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812739584 00000100:00100000:3.0:1787432586.767245:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812739584 00000100:00100000:3.0:1787432586.767342:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787432586.767352:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:6721:x1874258812739584:12345-0@lo:502: 00000100:00100000:3.0:1787432586.767561:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:6721:x1874258812739584:12345-0@lo:502: Request processed in 210us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432586.767568:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787432586.767648:0:6721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812739584:0@lo:502: 00000040:00080000:1.0:1787432586.767924:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787432586.767971:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787432586.768009:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787432586.768054:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787432586.768095:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787432586.768135:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787432586.768163:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787432586.768189:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787432586.768225:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787432586.768253:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787432586.768288:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787432586.768331:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787432586.768361:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787432586.768394:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787432586.768453:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787432586.768493:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787432586.768526:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787432586.768573:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787432586.768618:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787432586.768646:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787432586.768716:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787432586.768747:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787432586.768772:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787432586.768809:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787432586.768836:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787432586.768862:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787432586.768897:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787432586.768925:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1787432586.768965:0:6721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812739712:0@lo:502: 00000100:00100000:1.0:1787432586.769016:0:6721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432586.771177:0:6721:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87dc2300 going to sleep for 11 seconds 00000100:00100000:0.0:1787432586.771309:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812739712 00000100:00100000:0.0:1787432586.771319:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812739712 00000100:00100000:0.0:1787432586.771382:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787432586.771394:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:6721:x1874258812739712:12345-0@lo:502: 00000100:00100000:0.0:1787432586.771718:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:6721:x1874258812739712:12345-0@lo:502: Request processed in 326us (2700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432586.771727:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787432586.771854:0:6721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812739712:0@lo:502: 00000040:00080000:1.0:1787432586.771989:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787432586.772011:0:6721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787432586.773383:0:6744:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787432586.773412:0:6744:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff935b9078b370) 00000020:00000080:1.0:1787432586.773435:0:6744:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787432586.773530:0:6744:0:(tgt_mount.c:153:server_get_mount()) get mount ffff935bbb3e4800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787432586.773535:0:6744:0:(tgt_mount.c:187:server_put_mount()) put mount ffff935bbb3e4800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787432586.773538:0:6744:0:(obd_mount.c:710:lustre_put_lsi()) put ffff935bbb3e4800 3 00010000:00080000:1.0:1787432586.773569:0:6744:0:(ldlm_lib.c:102:import_set_conn()) imp ffff935a84bb7000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.115@tcp at head 00010000:00010000:1.0:1787432586.780144:0:6744:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787432586.780367:0:6744:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787432586.780412:0:6744:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787432586.780431:0:6744:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbcb9e331c3f0f8b2 00000100:00080000:1.0:1787432586.780452:0:6744:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787432586.780458:0:6744:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff935a84bb7000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787432586.780505:0:6744:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff935bb9557480 x1874258812739840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787432586.780530:0:6744:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787432586.780612:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874258812739968:0@lo:400: 00000100:00100000:1.0:1787432586.780715:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432586.780779:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812739968 00000100:00100000:1.0:1787432586.780785:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812739968 00000100:00100000:1.0:1787432586.780820:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432586.780828:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874258812739968:12345-0@lo:400: 00000100:00100000:1.0:1787432586.780873:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874258812739968:12345-0@lo:400: Request processed in 45us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432586.780880:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787432586.782734:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3329:1874258812739840:0@lo:38: 00010000:00080000:1.0:1787432586.783035:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff935bb9557100 x1874258812739968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432586.783050:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874258812739968:0@lo:400: 00000040:00080000:1.0:1787432586.783288:0:6744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1787432586.783560:0:6721:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1787432586.783584:0:6721:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787432586.783603:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0f89d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f8a4 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.783615:0:6721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0f89d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f8a4 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787432586.783727:0:6721:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787432586.783729:0:6721:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787432586.783731:0:6721:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787432586.783732:0:6721:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787432586.783733:0:6721:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787432586.783735:0:6721:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787432586.783736:0:6721:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787432586.783738:0:6721:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787432586.783739:0:6721:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787432586.783745:0:6721:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787432586.783746:0:6721:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787432586.783750:0:6721:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1787432586.783752:0:6721:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787432586.783753:0:6721:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787432586.783755:0:6721:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787432586.783756:0:6721:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787432586.783757:0:6721:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787432586.783758:0:6721:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787432586.783759:0:6721:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787432586.783760:0:6721:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787432586.783761:0:6721:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787432586.783762:0:6721:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787432586.783763:0:6721:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787432586.783783:0:6721:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787432586.783794:0:6721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812740096:0@lo:253: 00000100:00100000:3.0:1787432586.786475:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432586.786614:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812739840 00000100:00100000:1.0:1787432586.786624:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812739840 00000100:00100000:1.0:1787432586.786696:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432586.786705:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3329:x1874258812739840:12345-0@lo:38: 00010000:00080000:1.0:1787432586.786738:0:5869:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:1.0:1787432586.786779:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbcb9e331c3f0f8b9 00000004:00100000:1.0:1787432586.786797:0:5869:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787432586.786833:0:5869:0:(import.c:65:import_set_state_nolock()) ffff935a84bb5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787432586.786891:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874258812739840:12345-0@lo:38: Request processed in 185us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432586.786898:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787432586.786956:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff935bb9557480 x1874258812739840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432586.786968:0:3329:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787432586.786977:0:3329:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787432586.786984:0:3329:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787432586.786989:0:3329:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787432586.786991:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935a84bb7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787432586.786996:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3329:1874258812739840:0@lo:38: 00000100:00100000:0.0:1787432586.789567:0:6721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432586.789713:0:6721:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91a23f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432586.791212:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812740096 00000100:00100000:3.0:1787432586.791222:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812740096 00000100:00100000:3.0:1787432586.791284:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787432586.791295:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:6721:x1874258812740096:12345-0@lo:253: 20000000:01000000:3.0:1787432586.791330:0:5861:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787432586.791358:0:5861:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787432586.811281:0:5861:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787432586.811339:0:5861:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787432586.812615:0:5883:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787432586.812626:0:5883:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787432586.812652:0:5883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff935bc2166c00/0xbcb9e331c3f0f8c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.812694:0:5883:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bc2167200/0xbcb9e331c3f0f81f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f818 expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.812722:0:5883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff935bc2166c00/0xbcb9e331c3f0f8c0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.812769:0:5883:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bc2167200/0xbcb9e331c3f0f81f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f818 expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.812785:0:5883:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bc2167200/0xbcb9e331c3f0f81f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f818 expref: 13 pid: 5860 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432586.812800:0:5883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5883:1874258812740224:0@lo:104: 00000100:00100000:1.0:1787432586.812876:0:5883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432586.813127:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812740224 00000100:00100000:0.0:1787432586.813135:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812740224 00000100:00100000:0.0:1787432586.813186:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787432586.813200:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9557100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+3:5883:x1874258812740224:12345-0@lo:104: 00010000:00010000:0.0:1787432586.813215:0:5850:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bb5211800/0xbcb9e331c3f0f818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f81f expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432586.813308:0:5883:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87dc2480 going to sleep for 11 seconds 00010000:00010000:0.0:1787432586.813354:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787432586.813372:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9557100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+3:5883:x1874258812740224:12345-0@lo:104: Request processed in 178us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432586.813380:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787432586.813404:0:5855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432586.813410:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bb5211800/0xbcb9e331c3f0f818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f81f expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.813418:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bb5211800 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:0.0:1787432586.813428:0:5855:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bb5211800/0xbcb9e331c3f0f818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f81f expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.813435:0:5855:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bb5211800/0xbcb9e331c3f0f818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f81f expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432586.813456:0:5855:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bb5211800/0xbcb9e331c3f0f818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f81f expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432586.813461:0:5855:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432586.813496:0:5855:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bb5211800/0xbcb9e331c3f0f818 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f81f expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.813503:0:5855:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432586.813530:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bb5211800/0xbcb9e331c3f0f818 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f81f expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.813537:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bb5211800/0xbcb9e331c3f0f818 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f81f expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432586.813553:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432586.813555:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432586.813557:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432586.813805:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812740352:0@lo:103: 00000100:00100000:0.0:1787432586.813849:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432586.813984:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812740352 00000100:00100000:3.0:1787432586.813989:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812740352 00010000:00010000:3.0:1787432586.814011:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bc2167200/0xbcb9e331c3f0f81f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f818 expref: 14 pid: 5860 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432586.814576:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787432586.814588:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935ba07d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:3331:x1874258812740352:12345-0@lo:103: 00010000:00010000:3.0:1787432586.814600:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432586.814606:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bc2167200/0xbcb9e331c3f0f81f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f818 expref: 14 pid: 5860 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.814618:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bc2167200/0xbcb9e331c3f0f81f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f818 expref: 14 pid: 5860 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.814639:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff935bc2166c00/0xbcb9e331c3f0f8c0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.814647:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bc2166c00/0xbcb9e331c3f0f8c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787432586.814686:0:5853:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002061260s 00010000:00010000:3.0:1787432586.814692:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935bc2166c00/0xbcb9e331c3f0f8c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.814701:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935bc2166c00/0xbcb9e331c3f0f8c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.814708:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff935bc2166c00/0xbcb9e331c3f0f8c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.814715:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff935bc2166c00/0xbcb9e331c3f0f8c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.814734:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2166c00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:3.0:1787432586.814739:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff935bc2166c00/0xbcb9e331c3f0f8c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.814746:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff935bc2166c00/0xbcb9e331c3f0f8c0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.814755:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff935bc2166c00/0xbcb9e331c3f0f8c0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432586.814764:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432586.814783:0:5883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bc2167200/0xbcb9e331c3f0f81f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f818 expref: 14 pid: 5860 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432586.814796:0:5883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5883:1874258812740224:0@lo:104: 00000100:00100000:3.0:1787432586.814814:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935ba07d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:3331:x1874258812740352:12345-0@lo:103: Request processed in 229us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432586.814821:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787432586.814821:0:5883:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff935bc2166c00/0xbcb9e331c3f0f8c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.814830:0:5883:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff935bc2166c00/0xbcb9e331c3f0f8c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.814836:0:5883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff935bc2166c00/0xbcb9e331c3f0f8c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432586.814842:0:5883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bc2166c00/0xbcb9e331c3f0f8c0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432586.814924:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812740352:0@lo:103: 00000100:00100000:3.0:1787432586.822977:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:6721:x1874258812740096:12345-0@lo:253: Request processed in 31673us (33409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432586.822996:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787432586.823202:0:6721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6721:1874258812740096:0@lo:253: 10000000:01000000:0.0:1787432586.823217:0:6721:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787432586.823220:0:6721:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787432586.823235:0:6721:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787432586.823237:0:6721:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787432586.823238:0:6721:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787432586.823240:0:6721:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787432586.823241:0:6721:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787432586.823243:0:6721:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787432586.823244:0:6721:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787432586.823246:0:6721:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787432586.823247:0:6721:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787432586.823249:0:6721:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787432586.823269:0:6721:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787432586.828332:0:6721:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787432586.828565:0:6721:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787432586.828876:0:6721:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787432586.829202:0:6721:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787432586.833947:0:6721:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787432586.834255:0:6721:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787432586.835682:0:6721:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787432587.068231:0:6721:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787432587.068238:0:6721:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787432587.068286:0:6721:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787432587.068339:0:6721:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.115@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787432587.068362:0:6721:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787432587.068387:0:6721:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787432587.382814:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432588.406510:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432589.430911:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432590.462573:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787432590.839932:0:5864:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787432590.839940:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff935b90e92000 from 21 10000000:01000000:2.0:1787432590.839946:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787432590.839990:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f8c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432590.840003:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f8c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432590.840014:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f8c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432590.840040:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9524e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812740480:0@lo:101: 00000100:00100000:2.0:1787432590.840104:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432590.840156:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87099cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432590.841228:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812740480 00000100:00100000:3.0:1787432590.841240:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812740480 00000100:00100000:3.0:1787432590.841300:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787432590.841310:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:5864:x1874258812740480:12345-0@lo:101: 00010000:00010000:3.0:1787432590.841755:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432590.841774:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bc2154a00/0xbcb9e331c3f0f8ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f8c7 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432590.841947:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bc2154a00/0xbcb9e331c3f0f8ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f8c7 expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432590.841957:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bc2154a00/0xbcb9e331c3f0f8ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f8c7 expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432590.841968:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154a00, rc 0) 00000100:00100000:3.0:1787432590.842059:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:5864:x1874258812740480:12345-0@lo:101: Request processed in 749us (1954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432590.842066:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787432590.842232:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9524e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812740480:0@lo:101: 00010000:00010000:1.0:1787432590.842253:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f8c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f8ce expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432590.842263:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f8c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f8ce expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432590.842352:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812740608:0@lo:501: 00000100:00100000:1.0:1787432590.842695:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432590.842732:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b878c4480 going to sleep for 11 seconds 00000100:00100000:3.0:1787432590.843987:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812740608 00000100:00100000:3.0:1787432590.843997:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812740608 00000100:00100000:3.0:1787432590.844044:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787432590.844053:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:5864:x1874258812740608:12345-0@lo:501: 00000100:00100000:3.0:1787432590.844462:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:5864:x1874258812740608:12345-0@lo:501: Request processed in 407us (1765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432590.844470:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787432590.844800:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812740608:0@lo:501: 00000100:00100000:2.0:1787432590.844849:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9525180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812740736:0@lo:503: 00000100:00100000:2.0:1787432590.844896:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432590.844927:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a870990c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432590.844942:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812740736 00000100:00100000:2.0:1787432590.844946:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812740736 00000100:00100000:2.0:1787432590.844973:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787432590.844980:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:5864:x1874258812740736:12345-0@lo:503: 00000100:00100000:2.0:1787432590.845285:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:5864:x1874258812740736:12345-0@lo:503: Request processed in 304us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432590.845303:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787432590.845349:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9525180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812740736:0@lo:503: 00000100:00100000:2.0:1787432590.846874:0:6920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9525180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6920:1874258812740864:0@lo:502: 00000100:00100000:2.0:1787432590.846944:0:6920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432590.847017:0:6920:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87099300 going to sleep for 11 seconds 00000100:00100000:3.0:1787432590.850465:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812740864 00000100:00100000:3.0:1787432590.850482:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812740864 00000100:00100000:2.0:1787432590.850795:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787432590.850806:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:6920:x1874258812740864:12345-0@lo:502: 00000100:00100000:2.0:1787432590.851165:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:6920:x1874258812740864:12345-0@lo:502: Request processed in 360us (4219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432590.851173:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787432590.851238:0:6920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9525180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6920:1874258812740864:0@lo:502: 00000100:00100000:2.0:1787432590.851302:0:6920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9525180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6920:1874258812740992:0@lo:502: 00000100:00100000:2.0:1787432590.851343:0:6920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432590.851374:0:6920:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87099300 going to sleep for 11 seconds 00000100:00100000:0.0:1787432590.851816:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812740992 00000100:00100000:0.0:1787432590.851821:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812740992 00000100:00100000:0.0:1787432590.851854:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787432590.851861:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:6920:x1874258812740992:12345-0@lo:502: 00000100:00100000:0.0:1787432590.852023:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:6920:x1874258812740992:12345-0@lo:502: Request processed in 161us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432590.852030:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787432590.852119:0:6920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9525180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6920:1874258812740992:0@lo:502: 00000040:00080000:3.0:1787432590.852141:0:6920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1787432590.852343:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1787432590.852365:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787432590.852375:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f8c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f8ce expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432590.852387:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f8c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f8ce expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432590.852397:0:5864:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787432590.852399:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff935b90e92000 from 4 10000000:01000000:0.0:1787432590.852402:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787432590.852447:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0f8d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432590.852456:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0f8d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432590.852465:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0f8d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432590.852479:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812741120:0@lo:101: 00000100:00100000:0.0:1787432590.852521:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432590.852551:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91a23000 going to sleep for 11 seconds 00000100:00100000:2.0:1787432590.852686:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812741120 00000100:00100000:2.0:1787432590.852691:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812741120 00000100:00100000:2.0:1787432590.852719:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787432590.852726:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:5864:x1874258812741120:12345-0@lo:101: 00010000:00010000:2.0:1787432590.852736:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432590.852749:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f8dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f8d5 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432590.852769:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f8dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f8d5 expref: 14 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432590.852780:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f8dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f8d5 expref: 14 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432590.852797:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bb5210600, rc 0) 00000100:00100000:2.0:1787432590.852831:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:5864:x1874258812741120:12345-0@lo:101: Request processed in 105us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432590.852837:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787432590.853074:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812741120:0@lo:101: 00010000:00010000:0.0:1787432590.853087:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0f8d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f8dc expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432590.853095:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0f8d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f8dc expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432590.853142:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812741248:0@lo:256: 00000100:00100000:0.0:1787432590.853172:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432590.853201:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91a23000 going to sleep for 11 seconds 00000100:00100000:0.0:1787432590.853214:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812741248 00000100:00100000:0.0:1787432590.853217:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812741248 00000100:00100000:0.0:1787432590.853240:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787432590.853246:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:5864:x1874258812741248:12345-0@lo:256: 20000000:01000000:0.0:1787432590.853259:0:5862:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787432590.853276:0:5862:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787432590.853279:0:5862:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787432590.853357:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:5864:x1874258812741248:12345-0@lo:256: Request processed in 110us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432590.853364:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787432590.853415:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812741248:0@lo:256: 10000000:01000000:0.0:1787432590.853454:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787432590.853460:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0f8d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f8dc expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432590.853467:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0f8d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f8dc expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432590.853474:0:5864:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787432590.853476:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1787432590.853479:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787432590.853506:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f0f8e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432590.853514:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f0f8e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432590.853522:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f0f8e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432590.853534:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812741376:0@lo:101: 00000100:00100000:0.0:1787432590.853558:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432590.853761:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91a23000 going to sleep for 11 seconds 00000100:00100000:0.0:1787432590.853783:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812741376 00000100:00100000:0.0:1787432590.853787:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812741376 00000100:00100000:0.0:1787432590.853808:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787432590.853814:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:5864:x1874258812741376:12345-0@lo:101: 00010000:00010000:0.0:1787432590.853827:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432590.853836:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935b80031000/0xbcb9e331c3f0f8ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f8e3 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432590.853851:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935b80031000/0xbcb9e331c3f0f8ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f8e3 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432590.853860:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935b80031000/0xbcb9e331c3f0f8ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f8e3 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432590.853867:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80031000, rc 0) 00000100:00100000:0.0:1787432590.853894:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:5864:x1874258812741376:12345-0@lo:101: Request processed in 79us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432590.853900:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787432590.853930:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812741376:0@lo:101: 00010000:00010000:0.0:1787432590.853939:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f0f8e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f8ea expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432590.853947:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f0f8e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f8ea expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432590.853987:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812741504:0@lo:501: 00000100:00100000:0.0:1787432590.854008:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432590.854019:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91a23000 going to sleep for 11 seconds 00000100:00100000:0.0:1787432590.854030:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812741504 00000100:00100000:0.0:1787432590.854033:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812741504 00000100:00100000:0.0:1787432590.854053:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787432590.854059:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:5864:x1874258812741504:12345-0@lo:501: 00000100:00100000:0.0:1787432590.854289:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:5864:x1874258812741504:12345-0@lo:501: Request processed in 229us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432590.854295:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787432590.854329:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812741504:0@lo:501: 00000100:00100000:0.0:1787432590.854353:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812741632:0@lo:503: 00000100:00100000:0.0:1787432590.854635:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432590.854729:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91a23000 going to sleep for 11 seconds 00000100:00100000:2.0:1787432590.859033:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812741632 00000100:00100000:2.0:1787432590.859047:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812741632 00000100:00100000:2.0:1787432590.859103:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787432590.859113:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:5864:x1874258812741632:12345-0@lo:503: 00000100:00100000:2.0:1787432590.859538:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:5864:x1874258812741632:12345-0@lo:503: Request processed in 426us (5149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432590.859547:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787432590.859779:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812741632:0@lo:503: 00000100:00100000:3.0:1787432590.860263:0:6923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86833100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6923:1874258812741760:0@lo:502: 00000100:00100000:3.0:1787432590.860313:0:6923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432590.860350:0:6923:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b83008e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432590.860413:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812741760 00000100:00100000:2.0:1787432590.860419:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812741760 00000100:00100000:2.0:1787432590.860452:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787432590.860461:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:6923:x1874258812741760:12345-0@lo:502: 00000100:00100000:2.0:1787432590.860914:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:6923:x1874258812741760:12345-0@lo:502: Request processed in 452us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432590.860922:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787432590.861065:0:6923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86833100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6923:1874258812741760:0@lo:502: 00000020:01000000:3.0:1787432590.861099:0:6923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787432590.861106:0:6923:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787432590.861113:0:6923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432590.861115:0:6923:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787432590.861121:0:6923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787432590.861124:0:6923:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.115@tcp to nid 0x20000c0a8ca73 (192.168.202.115@tcp) 00000020:01000000:3.0:1787432590.861146:0:6923:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787432590.861149:0:6923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787432590.861163:0:6923:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff935b8683cd28) 00000020:00000080:3.0:1787432590.861182:0:6923:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787432590.861187:0:6923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787432590.861270:0:6923:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787432590.861276:0:6923:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787432590.861283:0:6923:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbcb9e331c3f0f8f8 00010000:00080000:3.0:1787432590.861309:0:6923:0:(ldlm_lib.c:102:import_set_conn()) imp ffff935b911eb800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.115@tcp at head 00010000:00010000:3.0:1787432590.863708:0:6923:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787432590.934799:0:6923:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787432590.934826:0:6923:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787432590.935624:0:6923:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787432590.935994:0:6923:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787432590.936047:0:6923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787432590.936108:0:6923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787432590.937012:0:6927:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787432590.937018:0:6927:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787432590.937959:0:6923:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787432590.937973:0:6923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787432590.938010:0:6923:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787432590.938030:0:6923:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbcb9e331c3f0f8ff 00000100:00080000:3.0:1787432590.938041:0:6923:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787432590.938046:0:6923:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff935b911eb800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:3.0:1787432590.938079:0:6923:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff935b86833100 x1874258812741888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787432590.938138:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812741888:0@lo:8: 00000100:00100000:1.0:1787432590.938206:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787432590.938271:0:6923:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787432590.938338:0:6923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432590.938342:0:6923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432590.938344:0:6923:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787432590.938347:0:6923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432590.938359:0:6923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432590.938360:0:6923:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787432590.938364:0:6923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787432590.938366:0:6923:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787432590.938516:0:6923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86830000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6923:1874258812742016:0@lo:502: 00000100:00100000:3.0:1787432590.938572:0:6923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432590.938591:0:6923:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b83008540 going to sleep for 11 seconds 00000100:00100000:3.0:1787432590.938616:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812741888 00000100:00100000:3.0:1787432590.938622:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812741888 00000100:00100000:3.0:1787432590.938652:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432590.938688:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3329:x1874258812741888:12345-0@lo:8: 00010000:00080000:3.0:1787432590.938713:0:6724:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:3.0:1787432590.938735:0:6724:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbcb9e331c3f0f906 00002000:00100000:3.0:1787432590.938765:0:6724:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff935b911ee800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787432590.938770:0:6724:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1787432590.938773:0:6724:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787432590.938970:0:6724:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787432590.939125:0:6724:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787432590.939150:0:6724:0:(import.c:65:import_set_state_nolock()) ffff935b911ec800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787432590.939863:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3329:x1874258812741888:12345-0@lo:8: Request processed in 1170us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432590.939874:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432590.939904:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812742016 00000100:00100000:3.0:1787432590.939909:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812742016 00000100:00100000:3.0:1787432590.939939:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787432590.939947:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:6923:x1874258812742016:12345-0@lo:502: 00000100:00100000:3.0:1787432590.940165:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:6923:x1874258812742016:12345-0@lo:502: Request processed in 218us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432590.940180:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787432590.940226:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812742272:0@lo:400: 00000100:00100000:3.0:1787432590.940255:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432590.940281:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432590.940286:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812742144:0@lo:400: 00000100:00100000:3.0:1787432590.940303:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432590.940340:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812742272 00000100:00100000:3.0:1787432590.940344:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812742272 00000100:00100000:3.0:1787432590.940373:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812742144 00000100:00100000:3.0:1787432590.940375:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812742144 00000100:00100000:3.0:1787432590.940748:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432590.940760:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812742272:12345-0@lo:400: 00000100:00100000:2.0:1787432590.940874:0:5869:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787432590.940885:0:5869:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787432590.940924:0:6923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86830000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:6923:1874258812742016:0@lo:502: 00000020:01000000:2.0:1787432590.940962:0:6923:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432590.940969:0:6923:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432590.940971:0:6923:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787432590.940978:0:6923:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:3.0:1787432590.941185:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812742272:12345-0@lo:400: Request processed in 428us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432590.941194:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432590.941211:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787432590.941218:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812742144:12345-0@lo:400: 00000100:00100000:3.0:1787432590.941247:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812742144:12345-0@lo:400: Request processed in 30us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432590.941254:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787432590.941274:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787432590.941347:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bb9525180 x1874258812742144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432590.941369:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812742144:0@lo:400: 00010000:00080000:2.0:1787432590.941515:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bb9524e00 x1874258812742272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432590.941526:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812742272:0@lo:400: 00000020:01000000:0.0:1787432590.941691:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787432590.941711:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787432590.941721:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f0f8e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f8ea expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432590.941731:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f0f8e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f8ea expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432590.941741:0:5864:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787432590.941743:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff935b879b0000 from 1 10000000:01000000:0.0:1787432590.941746:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787432590.941936:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f90d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432590.941956:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f90d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432590.941965:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f90d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432590.941983:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812742400:0@lo:101: 00000100:00100000:0.0:1787432590.942022:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432590.942090:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b878c4780 going to sleep for 11 seconds 00010000:00080000:1.0:1787432590.942179:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935b86833100 x1874258812741888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787432600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432590.942189:0:3329:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787432590.942196:0:3329:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787432590.942204:0:3329:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787432590.942208:0:3329:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787432590.942211:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935b911eb800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787432590.942294:0:3329:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787432590.942302:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812741888:0@lo:8: 00000004:00080000:3.0:1787432590.942531:0:6927:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787432590.942703:0:6927:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 225608044238ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787432590.946369:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812742400 00000100:00100000:2.0:1787432590.946381:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812742400 00000100:00100000:2.0:1787432590.946525:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787432590.946536:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:5864:x1874258812742400:12345-0@lo:101: 00010000:00010000:2.0:1787432590.946555:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432590.946633:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0f914 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f90d expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432590.946684:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0f914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f90d expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432590.946695:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0f914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f90d expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432590.946704:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bb5211600, rc 0) 00000100:00100000:2.0:1787432590.946843:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:5864:x1874258812742400:12345-0@lo:101: Request processed in 242us (4753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432590.946850:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787432590.951524:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812742400:0@lo:101: 00010000:00010000:0.0:1787432590.951554:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f90d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f914 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432590.951616:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f90d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f914 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432590.951698:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812742528:0@lo:501: 00000100:00100000:0.0:1787432590.951750:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432590.951835:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b878c4780 going to sleep for 11 seconds 00000100:00100000:2.0:1787432590.951892:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812742528 00000100:00100000:2.0:1787432590.951897:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812742528 00000100:00100000:2.0:1787432590.951965:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787432590.951973:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:5864:x1874258812742528:12345-0@lo:501: 00000100:00100000:2.0:1787432590.952157:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:5864:x1874258812742528:12345-0@lo:501: Request processed in 185us (406us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787432590.952163:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787432590.952230:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812742528:0@lo:501: 10000000:01000000:0.0:1787432590.952249:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787432590.952254:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f90d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f914 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432590.952261:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f90d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f914 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787432591.037900:0:5889:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787432591.138746:0:6928:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787432591.138791:0:6928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9554a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6928:1874258812742784:0@lo:7: 00000100:00100000:1.0:1787432591.138858:0:6928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432591.138907:0:6928:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b861c2240 going to sleep for 11 seconds 00000100:00100000:1.0:1787432591.138930:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812742656:0@lo:13: 00000100:00100000:1.0:1787432591.138956:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432591.139011:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812742784 00000100:00100000:3.0:1787432591.139019:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812742784 00000100:00100000:3.0:1787432591.139072:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787432591.139081:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6928:x1874258812742784:12345-0@lo:7: 00000100:00080000:0.0:1787432591.142075:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787432591.145937:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812742656 00000100:00100000:2.0:1787432591.145950:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812742656 00000100:00100000:2.0:1787432591.146012:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787432591.146022:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3330:x1874258812742656:12345-0@lo:13: 00002000:00000024:2.0:1787432591.146052:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787432591.146125:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3330:x1874258812742656:12345-0@lo:13: Request processed in 104us (7167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432591.146132:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787432591.146190:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bb9555880 x1874258812742656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432591.146210:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9555880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812742656:0@lo:13: 00002000:00080000:3.0:1787432591.152241:0:6726:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787432591.152250:0:6726:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787432591.153691:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6928:x1874258812742784:12345-0@lo:7: Request processed in 14604us (14826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432591.153703:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787432591.155771:0:6928:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bb9554a80 x1874258812742784/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787432607 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432591.155947:0:6928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9554a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6928:1874258812742784:0@lo:7: 00000004:00080000:1.0:1787432591.155962:0:6928:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787432591.156007:0:6928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9554a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6928:1874258812742912:0@lo:5: 00000100:00100000:1.0:1787432591.156066:0:6928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432591.156105:0:6928:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b861c2240 going to sleep for 11 seconds 00000100:00100000:1.0:1787432591.156135:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812742912 00000100:00100000:1.0:1787432591.156141:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812742912 00000100:00100000:1.0:1787432591.156202:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432591.156212:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6928:x1874258812742912:12345-0@lo:5: 00002000:00080000:1.0:1787432591.156240:0:6725:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787432591.156244:0:6725:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787432591.156916:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6928:x1874258812742912:12345-0@lo:5: Request processed in 702us (847us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787432591.156924:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787432591.156961:0:6928:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bb9554a80 x1874258812742912/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787432607 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432591.156974:0:6928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9554a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6928:1874258812742912:0@lo:5: 00000004:00080000:1.0:1787432591.156995:0:6928:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787432591.157024:0:6928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6928:1874258812743040:0@lo:700: 00000100:00100000:1.0:1787432591.157054:0:6928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432591.157117:0:6928:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b861c2240 going to sleep for 11 seconds 00000100:00100000:3.0:1787432591.163291:0:6732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812743040 00000100:00100000:3.0:1787432591.163307:0:6732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812743040 00000100:00100000:3.0:1787432591.163855:0:6732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432591.163867:0:6732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6928:x1874258812743040:12345-0@lo:700: 00000100:00100000:3.0:1787432591.163929:0:6732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86830a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6732:1874258812743168:0@lo:700: 00000100:00100000:3.0:1787432591.163993:0:6732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432591.164030:0:6732:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b83008540 going to sleep for 11 seconds 00000100:00100000:3.0:1787432591.164055:0:5874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812743168 00000100:00100000:3.0:1787432591.164060:0:5874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812743168 00000100:00100000:3.0:1787432591.164086:0:5874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432591.164093:0:5874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6732:x1874258812743168:12345-0@lo:700: 40000000:02000000:3.0:1787432591.327613:0:5874:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1787432591.340577:0:5874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6732:x1874258812743168:12345-0@lo:700: Request processed in 176474us (176574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432591.340592:0:5874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787432591.340794:0:6732:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935b86830a80 x1874258812743168/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787432607 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432591.340811:0:6732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86830a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6732:1874258812743168:0@lo:700: 40000000:02000000:0.0:1787432591.340824:0:6732:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1787432591.442593:0:6732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6928:x1874258812743040:12345-0@lo:700: Request processed in 278719us (285528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432591.442612:0:6732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787432591.442719:0:6928:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bb9557480 x1874258812743040/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787432607 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432591.442737:0:6928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6928:1874258812743040:0@lo:700: 00000001:00080000:3.0:1787432591.443541:0:6749:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1787432591.443556:0:6749:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787432591.479481:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:0.0:1787432591.524800:0:6928:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1787432591.530972:0:6928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0ab480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6928:1874258812743296:0@lo:5: 00000100:00100000:0.0:1787432591.531058:0:6928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432591.531128:0:6928:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91fa3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787432591.531263:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812743296 00000100:00100000:1.0:1787432591.531272:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812743296 00000100:00100000:1.0:1787432591.531378:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787432591.531395:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6928:x1874258812743296:12345-0@lo:5: 00002000:00080000:3.0:1787432591.538180:0:6726:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787432591.538203:0:6726:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787432591.543092:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6928:x1874258812743296:12345-0@lo:5: Request processed in 11692us (12028us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787432591.543106:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787432591.543523:0:6928:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bba0ab480 x1874258812743296/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787432607 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432591.543539:0:6928:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787432591.543555:0:6928:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff935bba0ab480 x1874258812743296/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787432607 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432591.543568:0:6928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0ab480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6928:1874258812743296:0@lo:5: 00000004:00080000:2.0:1787432591.543582:0:6928:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1787432592.502798:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432593.529166:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787432593.963968:0:7093:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787432594.550858:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432595.574522:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432596.214060:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812743424:0@lo:13: 00000100:00100000:0.0:1787432596.214141:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432596.214513:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812743424 00000100:00100000:2.0:1787432596.214535:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812743424 00000100:00100000:2.0:1787432596.214831:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432596.214857:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3331:x1874258812743424:12345-0@lo:13: 00002000:00000024:2.0:1787432596.214896:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432596.214954:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3331:x1874258812743424:12345-0@lo:13: Request processed in 101us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432596.214962:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787432596.215455:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787432596.215505:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bb9524e00 x1874258812743424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432596.215537:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812743424:0@lo:13: 00000100:00100000:1.0:1787432596.216129:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812743552:0@lo:400: 00000100:00100000:1.0:1787432596.216182:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432596.216260:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812743680:0@lo:400: 00000100:00100000:2.0:1787432596.216292:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432596.216366:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812743680 00000100:00100000:2.0:1787432596.216372:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812743680 00000100:00100000:2.0:1787432596.216414:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432596.216423:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812743680:12345-0@lo:400: 00000100:00100000:2.0:1787432596.216464:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812743680:12345-0@lo:400: Request processed in 43us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432596.216471:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787432596.216497:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935b86830700 x1874258812743680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432596.216507:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812743680:0@lo:400: 00000100:00100000:0.0:1787432596.218718:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812743808:0@lo:400: 00000100:00100000:0.0:1787432596.218793:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432596.219419:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812743808 00000100:00100000:1.0:1787432596.219430:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812743808 00000100:00100000:1.0:1787432596.219504:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787432596.219516:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812743808:12345-0@lo:400: 00000100:00100000:1.0:1787432596.219600:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812743808:12345-0@lo:400: Request processed in 87us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432596.219607:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787432596.222712:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787432596.222803:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935b86831f80 x1874258812743808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432596.222820:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812743808:0@lo:400: 00000100:00100000:3.0:1787432596.225684:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812743552 00000100:00100000:3.0:1787432596.225699:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812743552 00000100:00100000:2.0:1787432596.226809:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787432596.226824:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:3332:x1874258812743552:12345-0@lo:400: 00000100:00100000:2.0:1787432596.226924:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:3332:x1874258812743552:12345-0@lo:400: Request processed in 104us (10740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432596.226932:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787432596.227032:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812743552:0@lo:400: 00010000:00010000:0.0:1787432596.598155:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787432596.859051:0:6749:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1787432597.634973:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432598.653410:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432599.672511:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432600.694838:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432601.333953:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812743936:0@lo:400: 00000100:00100000:1.0:1787432601.334034:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432601.334348:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812743936 00000100:00100000:3.0:1787432601.334357:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812743936 00000100:00100000:3.0:1787432601.334407:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787432601.334415:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:3331:x1874258812743936:12345-0@lo:400: 00000100:00100000:1.0:1787432601.334908:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812744448:0@lo:13: 00000100:00100000:1.0:1787432601.334944:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432601.341430:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:3331:x1874258812743936:12345-0@lo:400: Request processed in 7006us (7386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432601.341447:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787432601.341638:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812744448 00000100:00100000:3.0:1787432601.341647:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812744448 00000100:00100000:3.0:1787432601.341720:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787432601.341729:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9557480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812744448:12345-0@lo:13: 00002000:00000024:3.0:1787432601.341762:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787432601.341819:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9557480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812744448:12345-0@lo:13: Request processed in 92us (6874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432601.341825:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787432601.341860:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432601.341876:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812744192:0@lo:400: 00000100:00100000:3.0:1787432601.341905:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432601.341933:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432601.341941:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812744064:0@lo:400: 00000100:00100000:3.0:1787432601.341961:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432601.341987:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812744320:0@lo:400: 00000100:00100000:3.0:1787432601.342015:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432601.342049:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812744192 00000100:00100000:3.0:1787432601.342053:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812744192 00000100:00100000:3.0:1787432601.342097:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812744064 00000100:00100000:3.0:1787432601.342101:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812744064 00000100:00100000:3.0:1787432601.342119:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432601.342126:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812744192:12345-0@lo:400: 00000100:00100000:3.0:1787432601.342161:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812744192:12345-0@lo:400: Request processed in 36us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432601.342167:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432601.342178:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787432601.342184:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812744064:12345-0@lo:400: 00000100:00100000:3.0:1787432601.342206:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812744064:12345-0@lo:400: Request processed in 24us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432601.342212:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787432601.342224:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787432601.342247:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bba0a8e00 x1874258812744064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432601.342260:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812744064:0@lo:400: 00010000:00080000:3.0:1787432601.342270:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bba0aa680 x1874258812744192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432601.342277:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812744192:0@lo:400: 00000100:00100000:3.0:1787432601.342625:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812744320 00000100:00100000:3.0:1787432601.342630:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812744320 00000100:00100000:3.0:1787432601.342678:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432601.342685:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812744320:12345-0@lo:400: 00000100:00100000:3.0:1787432601.342724:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812744320:12345-0@lo:400: Request processed in 40us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432601.342730:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787432601.342769:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bba0a8380 x1874258812744320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432601.342777:0:3330:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787432601.342788:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812744320:0@lo:400: 00000100:00100000:1.0:1787432601.356780:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812743936:0@lo:400: 00010000:00080000:1.0:1787432601.356865:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bb9526300 x1874258812744448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432601.356886:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812744448:0@lo:13: 00010000:00010000:0.0:1787432601.723931:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432602.742842:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432603.766207:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432604.409880:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812744832:0@lo:400: 00000100:00100000:0.0:1787432604.409951:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432604.410008:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432604.410014:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812744960:0@lo:400: 00000100:00100000:0.0:1787432604.410039:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432604.410070:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812744832 00000100:00100000:0.0:1787432604.410077:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812744832 00000100:00100000:0.0:1787432604.410134:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787432604.410144:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812744832:12345-0@lo:400: 00000100:00100000:0.0:1787432604.410210:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812744832:12345-0@lo:400: Request processed in 68us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432604.410218:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787432604.410247:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812744960 00000100:00100000:0.0:1787432604.410251:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812744960 00000100:00100000:0.0:1787432604.410298:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432604.410305:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812744960:12345-0@lo:400: 00000100:00100000:0.0:1787432604.410336:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812744960:12345-0@lo:400: Request processed in 32us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432604.410343:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787432604.410369:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787432604.410374:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787432604.410424:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bba0a8700 x1874258812744960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432604.410438:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812744960:0@lo:400: 00010000:00080000:0.0:1787432604.410450:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bba0aa300 x1874258812744832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432604.410459:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812744832:0@lo:400: 00000100:00100000:2.0:1787432604.410520:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812744704:0@lo:400: 00000100:00100000:2.0:1787432604.410553:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432604.410603:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432604.410610:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812744576:0@lo:400: 00000100:00100000:2.0:1787432604.410639:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432604.410707:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812744576 00000100:00100000:2.0:1787432604.410711:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812744576 00000100:00100000:2.0:1787432604.410740:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787432604.410746:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:3333:x1874258812744576:12345-0@lo:400: 00000100:00100000:2.0:1787432604.410780:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:3333:x1874258812744576:12345-0@lo:400: Request processed in 34us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432604.410785:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787432604.410820:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812744576:0@lo:400: 00000100:00100000:0.0:1787432604.410951:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812744704 00000100:00100000:0.0:1787432604.410956:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812744704 00000100:00100000:0.0:1787432604.410989:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787432604.410995:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812744704:12345-0@lo:400: 00000100:00100000:0.0:1787432604.411030:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812744704:12345-0@lo:400: Request processed in 35us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432604.411036:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787432604.411096:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bba0abb80 x1874258812744704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432604.411105:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812744704:0@lo:400: 00010000:00010000:1.0:1787432604.791623:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432605.815156:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432606.454749:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432606.454777:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812745088:0@lo:13: 00000100:00100000:2.0:1787432606.454850:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432606.454980:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812745088 00000100:00100000:0.0:1787432606.454990:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812745088 00000100:00100000:0.0:1787432606.455060:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432606.455069:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812745088:12345-0@lo:13: 00002000:00000024:0.0:1787432606.455102:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787432606.455153:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812745088:12345-0@lo:13: Request processed in 85us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432606.455160:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787432606.455288:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787432606.455318:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bba0aa300 x1874258812745088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432606.455337:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812745088:0@lo:13: 00000020:01000004:3.0:1787432606.759862:0:7666:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787432606.759867:0:7666:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787432606.760016:0:7666:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff935bbb06d800 00000020:01000004:3.0:1787432606.760034:0:7666:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787432606.760049:0:7666:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787432606.760064:0:7666:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff935b8683b370) 00000020:00000080:3.0:1787432606.760084:0:7666:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787432606.786111:0:7666:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787432606.786458:0:7666:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787432606.811413:0:7666:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787432606.817323:0:7666:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787432606.817363:0:7666:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787432606.817424:0:7666:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787432606.817451:0:7666:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787432606.818257:0:7666:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787432606.818279:0:7666:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787432606.818289:0:7666:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbcb9e331c3f0f922 00000020:01000004:3.0:1787432606.818297:0:7666:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787432606.818318:0:7666:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.115@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787432606.818321:0:7666:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787432606.818327:0:7666:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787432606.818348:0:7666:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787432606.818352:0:7666:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.115@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:0.0:1787432606.839080:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787432606.887243:0:7666:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787432606.887307:0:7666:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.115@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787432606.887312:0:7666:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787432606.887318:0:7666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787432606.887320:0:7666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432606.887321:0:7666:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432606.887322:0:7666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432606.887323:0:7666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432606.887325:0:7666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787432606.887326:0:7666:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787432606.887327:0:7666:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787432606.887329:0:7666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432606.887330:0:7666:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787432606.887334:0:7666:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787432606.887336:0:7666:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787432606.887337:0:7666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787432606.887338:0:7666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432606.887339:0:7666:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432606.887340:0:7666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432606.887341:0:7666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432606.887342:0:7666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787432606.887343:0:7666:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787432606.887344:0:7666:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787432606.887345:0:7666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432606.887345:0:7666:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787432606.887374:0:7666:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787432606.887392:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812745216:0@lo:253: 00000100:00100000:3.0:1787432606.887480:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432606.887547:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba0793780 going to sleep for 11 seconds 00000100:00100000:0.0:1787432606.887735:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812745216 00000100:00100000:0.0:1787432606.887744:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812745216 00000100:00100000:0.0:1787432606.887803:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787432606.887813:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:7666:x1874258812745216:12345-0@lo:253: 20000000:01000000:0.0:1787432606.887843:0:5860:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787432606.887847:0:5860:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787432606.887852:0:5860:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787432606.887856:0:5860:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787432606.888949:0:5860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787432606.889156:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787432606.889171:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787432606.889213:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787432606.889222:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787432606.889255:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787432606.889321:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787432606.889751:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1787432606.889772:0:5860:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.115@tcp 20000000:01000000:0.0:1787432606.889774:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.115@tcp (null) (null) (null) 00000040:00080000:0.0:1787432606.889809:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1787432606.889817:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787432606.889868:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1787432606.889877:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.115@tcp (null) (null) 00000040:00080000:0.0:1787432606.889909:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1787432606.889918:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787432606.889949:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1787432606.890000:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1787432606.890760:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1787432606.890779:0:5860:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.115@tcp 20000000:01000000:0.0:1787432606.890780:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.115@tcp (null) (null) (null) 00000040:00080000:0.0:1787432606.890813:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1787432606.890821:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787432606.890850:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1787432606.890856:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.115@tcp (null) (null) 00000040:00080000:0.0:1787432606.890898:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1787432606.890906:0:5860:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787432606.890956:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1787432606.891009:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1787432606.891027:0:5860:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1787432606.891030:0:5860:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1787432606.891036:0:5860:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787432606.891037:0:5860:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787432606.891039:0:5860:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787432606.891050:0:5860:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787432606.891053:0:5860:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787432606.891086:0:5860:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787432606.891089:0:5860:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787432606.926243:0:7668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787432606.926873:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787432606.927375:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787432606.927495:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787432606.927511:0:5860:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787432606.927514:0:5860:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787432606.944685:0:7669:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787432606.945748:0:7669:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787432606.947467:0:7669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787432606.948095:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787432606.948140:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787432606.948228:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787432606.948244:0:5860:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787432606.948273:0:5860:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787432606.952757:0:7670:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1787432606.952853:0:7670:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1787432606.952910:0:7670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787432606.953959:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1787432606.954010:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1787432606.954049:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1787432606.954065:0:5860:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787432606.954068:0:5860:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787432606.957547:0:7671:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787432606.957637:0:7671:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787432606.957713:0:7671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1787432606.958401:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1787432606.958427:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1787432606.958472:0:5860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1787432606.958486:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787432606.958501:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f929 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.958514:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0f87a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f873 expref: 16 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.958529:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bc2155600/0xbcb9e331c3f0f8a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f89d expref: 16 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.958534:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bc2154a00/0xbcb9e331c3f0f8ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f8c7 expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.958537:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935b80031000/0xbcb9e331c3f0f8ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f8e3 expref: 16 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.958541:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0f914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f90d expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.958546:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f929 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.958578:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0f914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f90d expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.958588:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0f914 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f90d expref: 16 pid: 5860 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432606.958600:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874258812745344:0@lo:104: 00000100:00100000:0.0:1787432606.958961:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787432606.959007:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935b80031000/0xbcb9e331c3f0f8ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f8e3 expref: 16 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.959013:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935b80031000/0xbcb9e331c3f0f8ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f8e3 expref: 16 pid: 5862 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432606.959019:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874258812745472:0@lo:104: 00010000:00010000:0.0:1787432606.959043:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bc2154a00/0xbcb9e331c3f0f8ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f8c7 expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.959048:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bc2154a00/0xbcb9e331c3f0f8ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f8c7 expref: 16 pid: 5860 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432606.959053:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0aaa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874258812745600:0@lo:104: 00010000:00010000:0.0:1787432606.959063:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bc2155600/0xbcb9e331c3f0f8a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f89d expref: 16 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.959067:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bc2155600/0xbcb9e331c3f0f8a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f89d expref: 16 pid: 5862 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432606.959072:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0aad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874258812745728:0@lo:104: 00010000:00010000:0.0:1787432606.959082:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0f87a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f873 expref: 16 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432606.959087:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0f87a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f873 expref: 16 pid: 5862 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432606.959091:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0aa300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874258812745856:0@lo:104: 00000100:00100000:0.0:1787432606.959099:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba81acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432606.959146:0:5849:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787432606.959161:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432606.959177:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432606.959182:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432606.959187:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432606.959193:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812745344 00000100:00100000:1.0:1787432606.959198:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812745344 00000100:00100000:1.0:1787432606.959225:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812745472 00000100:00100000:1.0:1787432606.959226:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812745472 00000100:00100000:1.0:1787432606.959231:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812745600 00000100:00100000:1.0:1787432606.959233:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812745600 00000100:00100000:1.0:1787432606.959237:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812745728 00000100:00100000:1.0:1787432606.959238:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812745728 00000100:00100000:1.0:1787432606.959245:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812745856 00000100:00100000:1.0:1787432606.959247:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812745856 00000100:00100000:1.0:1787432606.959269:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787432606.959278:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+7:5860:x1874258812745344:12345-0@lo:104: 00010000:00010000:1.0:1787432606.959291:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f90d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f914 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.959341:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787432606.959351:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+7:5860:x1874258812745344:12345-0@lo:104: Request processed in 75us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432606.959356:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787432606.959388:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787432606.959392:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9557800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+6:5860:x1874258812745472:12345-0@lo:104: 00010000:00010000:1.0:1787432606.959397:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f0f8e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f8ea expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.959421:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787432606.959424:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9557800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+6:5860:x1874258812745472:12345-0@lo:104: Request processed in 32us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432606.959429:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787432606.959457:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787432606.959463:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9554380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+5:5860:x1874258812745600:12345-0@lo:104: 00010000:00010000:1.0:1787432606.959471:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f8c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f8ce expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.959497:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787432606.959501:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9554380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+5:5860:x1874258812745600:12345-0@lo:104: Request processed in 40us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432606.959506:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787432606.959517:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787432606.959522:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9555180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+4:5860:x1874258812745728:12345-0@lo:104: 00010000:00010000:1.0:1787432606.959529:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0f89d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f8a4 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.959550:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787432606.959557:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9555180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+4:5860:x1874258812745728:12345-0@lo:104: Request processed in 36us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432606.959561:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787432606.959570:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787432606.959573:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9557b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+3:5860:x1874258812745856:12345-0@lo:104: 00010000:00010000:1.0:1787432606.959578:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f87a expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.959594:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787432606.959597:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9557b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+3:5860:x1874258812745856:12345-0@lo:104: Request processed in 24us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432606.959600:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787432606.959612:0:5855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787432606.959616:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f90d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f914 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.959622:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031a00 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:1.0:1787432606.959625:0:5855:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f90d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f914 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.959630:0:5855:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f90d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f914 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432606.959635:0:5855:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f90d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f914 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432606.959640:0:5855:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432606.959685:0:5855:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f90d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f914 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.959697:0:5855:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432606.959712:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f90d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f914 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.959910:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f90d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f914 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.959922:0:5855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787432606.959924:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f0f8e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f8ea expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.959928:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030000 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:1.0:1787432606.959930:0:5855:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f0f8e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f8ea expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.959934:0:5855:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f0f8e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f8ea expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432606.959937:0:5855:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f0f8e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f8ea expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432606.959940:0:5855:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432606.959951:0:5855:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f0f8e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f8ea expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.959955:0:5855:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432606.959967:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f0f8e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f8ea expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.959971:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f0f8e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f8ea expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.959982:0:5855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787432606.959984:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f8c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f8ce expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.959987:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bb5210400 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:1.0:1787432606.959989:0:5855:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f8c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f8ce expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.959992:0:5855:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f8c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f8ce expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432606.959996:0:5855:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f8c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f8ce expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432606.959998:0:5855:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432606.960006:0:5855:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f8c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f8ce expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960009:0:5855:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432606.960012:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f8c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f8ce expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960016:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bb5210400/0xbcb9e331c3f0f8c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f8ce expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960021:0:5855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432606.960023:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0f89d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f8a4 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960032:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031200 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:1.0:1787432606.960034:0:5855:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0f89d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f8a4 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960038:0:5855:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0f89d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f8a4 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432606.960041:0:5855:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0f89d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f8a4 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432606.960044:0:5855:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432606.960050:0:5855:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0f89d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f8a4 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960053:0:5855:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432606.960056:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0f89d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f8a4 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960060:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0f89d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f8a4 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960064:0:5855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432606.960066:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f87a expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960069:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2166800 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:1.0:1787432606.960071:0:5855:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f87a expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960081:0:5855:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f87a expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432606.960085:0:5855:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f87a expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432606.960087:0:5855:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432606.960094:0:5855:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f873 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f87a expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960098:0:5855:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432606.960100:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f873 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f87a expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960103:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f873 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f87a expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960113:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432606.960114:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432606.960115:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432606.960132:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812746368:0@lo:103: 00000100:00100000:1.0:1787432606.960157:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432606.960182:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787432606.960186:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812745984:0@lo:103: 00000100:00100000:1.0:1787432606.960208:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432606.960221:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812746496:0@lo:103: 00000100:00100000:1.0:1787432606.960234:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432606.960250:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812746112:0@lo:103: 00000100:00100000:1.0:1787432606.960293:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432606.960305:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432606.960310:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812746240:0@lo:103: 00000100:00100000:1.0:1787432606.960327:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432606.960345:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812746368 00000100:00100000:1.0:1787432606.960349:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812746368 00010000:00010000:1.0:1787432606.960364:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bc2155600/0xbcb9e331c3f0f8a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f89d expref: 17 pid: 5862 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432606.960375:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812745984 00000100:00100000:1.0:1787432606.960376:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812745984 00010000:00010000:1.0:1787432606.960381:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0f914 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f90d expref: 18 pid: 5860 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432606.960386:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812746496 00000100:00100000:1.0:1787432606.960387:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812746496 00010000:00010000:1.0:1787432606.960392:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0f87a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f873 expref: 19 pid: 5862 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432606.960397:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812746112 00000100:00100000:1.0:1787432606.960398:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812746112 00010000:00010000:1.0:1787432606.960402:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935b80031000/0xbcb9e331c3f0f8ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f8e3 expref: 20 pid: 5862 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432606.960407:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812746240 00000100:00100000:1.0:1787432606.960408:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812746240 00010000:00010000:1.0:1787432606.960413:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bc2154a00/0xbcb9e331c3f0f8ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f8c7 expref: 21 pid: 5860 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432606.960419:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787432606.960422:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9554a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+21:3332:x1874258812746368:12345-0@lo:103: 00010000:00010000:1.0:1787432606.960436:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432606.960439:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bc2155600/0xbcb9e331c3f0f8a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f89d expref: 21 pid: 5862 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960445:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bc2155600/0xbcb9e331c3f0f8a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f89d expref: 21 pid: 5862 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960457:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432606.960477:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9554a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+21:3332:x1874258812746368:12345-0@lo:103: Request processed in 54us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432606.960481:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787432606.960490:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787432606.960494:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+20:3332:x1874258812745984:12345-0@lo:103: 00010000:00010000:1.0:1787432606.960498:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432606.960501:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0f914 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f90d expref: 20 pid: 5860 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960507:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0f914 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f90d expref: 20 pid: 5860 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960512:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432606.960523:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+20:3332:x1874258812745984:12345-0@lo:103: Request processed in 29us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432606.960526:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787432606.960538:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787432606.960541:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812746496:12345-0@lo:103: 00010000:00010000:1.0:1787432606.960545:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432606.960548:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0f87a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f873 expref: 19 pid: 5862 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960557:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0f87a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f873 expref: 19 pid: 5862 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960563:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432606.960576:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812746496:12345-0@lo:103: Request processed in 35us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432606.960580:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787432606.960587:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787432606.960591:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:3330:x1874258812746112:12345-0@lo:103: 00010000:00010000:1.0:1787432606.960597:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432606.960599:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935b80031000/0xbcb9e331c3f0f8ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f8e3 expref: 18 pid: 5862 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960604:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935b80031000/0xbcb9e331c3f0f8ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f8e3 expref: 18 pid: 5862 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960609:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432606.960622:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:3330:x1874258812746112:12345-0@lo:103: Request processed in 32us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432606.960626:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787432606.960633:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787432606.960637:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:3330:x1874258812746240:12345-0@lo:103: 00010000:00010000:1.0:1787432606.960641:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432606.960643:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bc2154a00/0xbcb9e331c3f0f8ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f8c7 expref: 17 pid: 5860 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960648:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bc2154a00/0xbcb9e331c3f0f8ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f8c7 expref: 17 pid: 5860 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960683:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f929 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960688:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f929 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960697:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f929 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960701:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f929 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960706:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f929 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960713:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f929 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.960736:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030400 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432606.960740:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f929 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432606.961082:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812745984:0@lo:103: 00000100:00100000:0.0:1787432606.961091:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812746496:0@lo:103: 00000100:00100000:0.0:1787432606.961097:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812746368:0@lo:103: 00000100:00100000:0.0:1787432606.961131:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812746112:0@lo:103: 00010000:00010000:3.0:1787432606.961599:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0f914 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f90d expref: 17 pid: 5860 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432606.961615:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874258812745344:0@lo:104: 00010000:00010000:3.0:1787432606.961628:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935b80031000/0xbcb9e331c3f0f8ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f8e3 expref: 16 pid: 5862 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432606.961652:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874258812745472:0@lo:104: 00010000:00010000:3.0:1787432606.961688:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bc2154a00/0xbcb9e331c3f0f8ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f8c7 expref: 15 pid: 5860 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432606.961699:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0aaa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874258812745600:0@lo:104: 00010000:00010000:3.0:1787432606.961711:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bc2155600/0xbcb9e331c3f0f8a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f89d expref: 14 pid: 5862 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432606.961740:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0aad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874258812745728:0@lo:104: 00010000:00010000:3.0:1787432606.961773:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0f87a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f873 expref: 13 pid: 5862 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432606.961783:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0aa300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5860:1874258812745856:0@lo:104: 00010000:00010000:3.0:1787432606.961808:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f929 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.961818:0:5860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f929 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432606.961824:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f929 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787432606.961832:0:5860:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1787432606.962088:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432606.965010:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f929 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.965037:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f929 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.965043:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f929 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432606.965087:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432606.968672:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:3330:x1874258812746240:12345-0@lo:103: Request processed in 8007us (8316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432606.968688:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787432606.985134:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9554e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812746240:0@lo:103: 00000100:00100000:1.0:1787432607.111587:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:7666:x1874258812745216:12345-0@lo:253: Request processed in 223764us (224096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432607.111605:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787432607.111747:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812745216:0@lo:253: 10000000:01000000:3.0:1787432607.111763:0:7666:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787432607.111766:0:7666:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787432607.111769:0:7666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787432607.111785:0:7666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432607.111786:0:7666:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787432607.111788:0:7666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432607.111789:0:7666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432607.111791:0:7666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787432607.111793:0:7666:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787432607.111794:0:7666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432607.111795:0:7666:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787432607.111816:0:7666:0:(tgt_mount.c:101:server_register_mount()) register mount ffff935bbb06d800 from lustre-OST0001 10000000:01000000:3.0:1787432607.111840:0:7666:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787432607.111842:0:7666:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787432607.111850:0:7666:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff935b879b0000 local copy 10000000:01000000:3.0:1787432607.111854:0:7666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787432607.111889:0:7666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2155600/0xbcb9e331c3f0f930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.111899:0:7666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.115@tcp lock: ffff935bc2155600/0xbcb9e331c3f0f930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.111907:0:7666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bc2155600/0xbcb9e331c3f0f930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432607.111925:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812746624:0@lo:101: 00000100:00100000:3.0:1787432607.111963:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432607.112020:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba0793180 going to sleep for 11 seconds 00000100:00100000:0.0:1787432607.112303:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812746624 00000100:00100000:0.0:1787432607.112319:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812746624 00000100:00100000:0.0:1787432607.112379:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787432607.112388:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+11:7666:x1874258812746624:12345-0@lo:101: 00010000:00010000:0.0:1787432607.112400:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432607.112412:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935b80030c00/0xbcb9e331c3f0f937 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f930 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.112434:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935b80030c00/0xbcb9e331c3f0f937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f930 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.112444:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935b80030c00/0xbcb9e331c3f0f937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f930 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.112453:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80030c00, rc 0) 00000100:00100000:0.0:1787432607.112496:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:7666:x1874258812746624:12345-0@lo:101: Request processed in 109us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432607.112503:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787432607.112648:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812746624:0@lo:101: 00010000:00010000:1.0:1787432607.112698:0:7666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bc2155600/0xbcb9e331c3f0f930 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbcb9e331c3f0f937 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.112707:0:7666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bc2155600/0xbcb9e331c3f0f930 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbcb9e331c3f0f937 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432607.112830:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812746752:0@lo:501: 00000100:00100000:1.0:1787432607.112859:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432607.112879:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b874fe480 going to sleep for 11 seconds 00000100:00100000:3.0:1787432607.113041:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812746752 00000100:00100000:3.0:1787432607.113047:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812746752 00000100:00100000:3.0:1787432607.113084:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787432607.113092:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:7666:x1874258812746752:12345-0@lo:501: 00000100:00100000:3.0:1787432607.114039:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:7666:x1874258812746752:12345-0@lo:501: Request processed in 945us (1176us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787432607.114049:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787432607.115414:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812746752:0@lo:501: 10000000:01000000:1.0:1787432607.115513:0:7666:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787432607.115572:0:7666:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787432607.115857:0:7666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2155600/0xbcb9e331c3f0f930 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbcb9e331c3f0f937 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.115867:0:7666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2155600/0xbcb9e331c3f0f930 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbcb9e331c3f0f937 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.115893:0:7666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff935bc2155600/0xbcb9e331c3f0f930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbcb9e331c3f0f937 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.115963:0:7666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787432607.115994:0:7666:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff935bbb06d800 10000000:01000000:1.0:1787432607.116000:0:7666:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787432607.116006:0:7666:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787432607.116008:0:7666:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787432607.116012:0:7666:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787432607.116015:0:7666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787432607.116047:0:7666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f93e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.116054:0:7666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f93e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.116064:0:7666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f93e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432607.116083:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812746880:0@lo:101: 00000100:00100000:1.0:1787432607.116154:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432607.116280:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b874fe780 going to sleep for 11 seconds 00000100:00100000:2.0:1787432607.116365:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812746880 00000100:00100000:2.0:1787432607.116373:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812746880 00000100:00100000:2.0:1787432607.116420:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787432607.116429:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:7666:x1874258812746880:12345-0@lo:101: 00010000:00010000:2.0:1787432607.116447:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432607.116459:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bb5210400/0xbcb9e331c3f0f945 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f93e expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.116481:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bb5210400/0xbcb9e331c3f0f945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f93e expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.116491:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bb5210400/0xbcb9e331c3f0f945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f93e expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.116499:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bb5210400, rc 0) 00000100:00100000:2.0:1787432607.116550:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:7666:x1874258812746880:12345-0@lo:101: Request processed in 122us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432607.116556:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787432607.116933:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812746880:0@lo:101: 00010000:00010000:3.0:1787432607.116947:0:7666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f93e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f945 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.116957:0:7666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f93e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f945 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432607.117062:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812747008:0@lo:501: 00000100:00100000:3.0:1787432607.117109:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432607.117139:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba0793240 going to sleep for 11 seconds 00000100:00100000:1.0:1787432607.117294:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812747008 00000100:00100000:1.0:1787432607.117299:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812747008 00000100:00100000:1.0:1787432607.117343:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787432607.117350:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:7666:x1874258812747008:12345-0@lo:501: 00000100:00100000:1.0:1787432607.117580:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:7666:x1874258812747008:12345-0@lo:501: Request processed in 230us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432607.117596:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787432607.118082:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812747008:0@lo:501: 00000100:00100000:3.0:1787432607.118130:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812747136:0@lo:503: 00000100:00100000:3.0:1787432607.118186:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432607.118215:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba0793240 going to sleep for 11 seconds 00000100:00100000:1.0:1787432607.118880:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812747136 00000100:00100000:1.0:1787432607.118887:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812747136 00000100:00100000:1.0:1787432607.118930:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787432607.118938:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:7666:x1874258812747136:12345-0@lo:503: 00000100:00100000:1.0:1787432607.119118:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:7666:x1874258812747136:12345-0@lo:503: Request processed in 179us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432607.119125:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787432607.119498:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812747136:0@lo:503: 00000040:00080000:3.0:1787432607.119998:0:7666:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787432607.120095:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812747264:0@lo:502: 00000100:00100000:3.0:1787432607.120147:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432607.120519:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812747264 00000100:00100000:2.0:1787432607.120526:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812747264 00000100:00100000:2.0:1787432607.120560:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787432607.120569:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:7666:x1874258812747264:12345-0@lo:502: 00000100:00100000:3.0:1787432607.120872:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba0793240 going to sleep for 11 seconds 00000100:00100000:2.0:1787432607.121001:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:7666:x1874258812747264:12345-0@lo:502: Request processed in 431us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432607.121009:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787432607.121109:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812747264:0@lo:502: 00000040:00080000:3.0:1787432607.121888:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787432607.121949:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787432607.121984:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787432607.122033:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787432607.122072:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787432607.122107:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787432607.122147:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812747392:0@lo:502: 00010000:00010000:0.0:1787432607.122284:0:5855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432607.122294:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bc2155600/0xbcb9e331c3f0f930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbcb9e331c3f0f937 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.122305:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155600 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:0.0:1787432607.122310:0:5855:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bc2155600/0xbcb9e331c3f0f930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbcb9e331c3f0f937 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.122320:0:5855:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bc2155600/0xbcb9e331c3f0f930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xbcb9e331c3f0f937 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432607.122328:0:5855:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bc2155600/0xbcb9e331c3f0f930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xbcb9e331c3f0f937 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432607.122420:0:5855:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432607.122890:0:5855:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bc2155600/0xbcb9e331c3f0f930 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbcb9e331c3f0f937 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.122899:0:5855:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432607.122930:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bc2155600/0xbcb9e331c3f0f930 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbcb9e331c3f0f937 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.122938:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bc2155600/0xbcb9e331c3f0f930 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbcb9e331c3f0f937 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.122954:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432607.122955:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432607.122957:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432607.123103:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787432607.123119:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812747520:0@lo:103: 00000100:00100000:1.0:1787432607.123253:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432607.123472:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432607.123521:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba0793240 going to sleep for 11 seconds 00000100:00100000:0.0:1787432607.124025:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812747392 00000100:00100000:0.0:1787432607.124034:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812747392 00000100:00100000:0.0:1787432607.124083:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787432607.124091:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:7666:x1874258812747392:12345-0@lo:502: 00000100:00100000:0.0:1787432607.124482:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:7666:x1874258812747392:12345-0@lo:502: Request processed in 389us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432607.124490:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787432607.124870:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812747520 00000100:00100000:3.0:1787432607.124876:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812747520 00000100:00100000:3.0:1787432607.124919:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787432607.124927:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:3331:x1874258812747520:12345-0@lo:103: 00010000:00010000:3.0:1787432607.124937:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432607.124956:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935b80030c00/0xbcb9e331c3f0f937 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbcb9e331c3f0f930 expref: 13 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.124972:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432607.125015:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:3331:x1874258812747520:12345-0@lo:103: Request processed in 90us (1763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432607.125022:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787432607.125062:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812747392:0@lo:502: 00000040:00080000:3.0:1787432607.125232:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787432607.125247:0:7666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000100:00100000:1.0:1787432607.125705:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812747520:0@lo:103: 00000020:01000000:2.0:1787432607.126234:0:7673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787432607.126243:0:7673:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787432607.126249:0:7673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432607.126251:0:7673:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787432607.126265:0:7673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787432607.126280:0:7673:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff935bbae799b8) 00000020:00000080:2.0:1787432607.126304:0:7673:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787432607.126312:0:7673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787432607.126506:0:7673:0:(tgt_mount.c:153:server_get_mount()) get mount ffff935bbb06d800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787432607.126515:0:7673:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787432607.126522:0:7673:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbcb9e331c3f0f953 00010000:00010000:3.0:1787432607.138709:0:7673:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787432607.139271:0:7673:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787432607.142119:0:7673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787432607.142478:0:7673:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787432607.145309:0:7673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787432607.147486:0:7673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787432607.149712:0:7673:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787432607.149964:0:7673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432607.150028:0:7673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432607.150032:0:7673:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787432607.150038:0:7673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432607.150042:0:7673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432607.150044:0:7673:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787432607.150047:0:7673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787432607.150048:0:7673:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787432607.150100:0:7673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432607.150103:0:7673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432607.150105:0:7673:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787432607.150108:0:7673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787432607.150319:0:7666:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787432607.150356:0:7666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787432607.150378:0:7666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f93e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f945 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.150407:0:7666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f93e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f945 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432607.150414:0:7666:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff935bbb06d800 from 1 10000000:01000000:3.0:1787432607.150417:0:7666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787432607.150452:0:7666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f0f95a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.150460:0:7666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f0f95a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.150471:0:7666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f0f95a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432607.150494:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812747648:0@lo:101: 00000100:00100000:3.0:1787432607.150565:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432607.150610:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba07930c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432607.150763:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812747648 00000100:00100000:0.0:1787432607.150771:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812747648 00000100:00100000:0.0:1787432607.150822:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787432607.150834:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:7666:x1874258812747648:12345-0@lo:101: 00010000:00010000:0.0:1787432607.150847:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432607.150867:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935b80031c00/0xbcb9e331c3f0f961 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f95a expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.150893:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935b80031c00/0xbcb9e331c3f0f961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f95a expref: 13 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.150905:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935b80031c00/0xbcb9e331c3f0f961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f95a expref: 13 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.150914:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80031c00, rc 0) 00000100:00100000:0.0:1787432607.150956:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:7666:x1874258812747648:12345-0@lo:101: Request processed in 125us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432607.150963:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787432607.151207:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812747648:0@lo:101: 00010000:00010000:3.0:1787432607.151222:0:7666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f0f95a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f961 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432607.151231:0:7666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f0f95a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f961 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432607.151349:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812747776:0@lo:501: 00000100:00100000:3.0:1787432607.151393:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432607.151416:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba07930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432607.151437:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812747776 00000100:00100000:3.0:1787432607.151442:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812747776 00000100:00100000:3.0:1787432607.151470:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787432607.151477:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:7666:x1874258812747776:12345-0@lo:501: 00000100:00100000:3.0:1787432607.151984:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:7666:x1874258812747776:12345-0@lo:501: Request processed in 506us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432607.151992:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787432607.152033:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812747776:0@lo:501: 00000100:00100000:3.0:1787432607.152063:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812747904:0@lo:503: 00000100:00100000:3.0:1787432607.152101:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432607.152122:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba07930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432607.152137:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812747904 00000100:00100000:3.0:1787432607.152141:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812747904 00000100:00100000:3.0:1787432607.152159:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787432607.152165:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:7666:x1874258812747904:12345-0@lo:503: 00000100:00100000:3.0:1787432607.152964:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:7666:x1874258812747904:12345-0@lo:503: Request processed in 794us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432607.152972:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787432607.153531:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812747904:0@lo:503: 00000040:00080000:1.0:1787432607.157187:0:7666:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787432607.157294:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812748032:0@lo:502: 00000100:00100000:1.0:1787432607.157388:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432607.157444:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b874fe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432607.157582:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812748032 00000100:00100000:0.0:1787432607.157589:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812748032 00000100:00100000:0.0:1787432607.157647:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787432607.157684:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:7666:x1874258812748032:12345-0@lo:502: 00000100:00100000:0.0:1787432607.157922:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:7666:x1874258812748032:12345-0@lo:502: Request processed in 264us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432607.157930:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787432607.158415:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812748032:0@lo:502: 00000040:00080000:1.0:1787432607.158980:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787432607.159044:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787432607.159077:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812748160:0@lo:502: 00000100:00100000:1.0:1787432607.159128:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432607.159227:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b874fe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432607.161483:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812748160 00000100:00100000:0.0:1787432607.161497:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812748160 00000100:00100000:0.0:1787432607.161566:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787432607.161577:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87907850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:7666:x1874258812748160:12345-0@lo:502: 00000100:00100000:0.0:1787432607.163579:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87907850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:7666:x1874258812748160:12345-0@lo:502: Request processed in 1996us (4442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432607.163593:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787432607.163925:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812748160:0@lo:502: 00000040:00080000:2.0:1787432607.164089:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787432607.164106:0:7666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787432607.167768:0:7677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432607.167782:0:7677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432607.167784:0:7677:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787432607.167791:0:7677:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff935bbb06d800 00000020:00000080:2.0:1787432607.167793:0:7677:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787432607.167814:0:7677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432607.167817:0:7677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432607.167819:0:7677:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787432607.167822:0:7677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787432607.168079:0:7666:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787432607.168110:0:7666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787432607.168146:0:7666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f0f95a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f961 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.168159:0:7666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f0f95a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f961 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432607.168214:0:7666:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787432607.168217:0:7666:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff935bbb06d800 10000000:01000000:0.0:1787432607.168221:0:7666:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff935bbb06d800 10000000:01000000:0.0:1787432607.168225:0:7666:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787432607.168231:0:7666:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff935bbb06d800 from 1 10000000:01000000:0.0:1787432607.168235:0:7666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787432607.168295:0:7666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0f968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.168305:0:7666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0f968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.168317:0:7666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0f968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432607.168353:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812748288:0@lo:101: 00000100:00100000:0.0:1787432607.168436:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432607.168476:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba81a000 going to sleep for 11 seconds 00000100:00100000:2.0:1787432607.169378:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812748288 00000100:00100000:2.0:1787432607.169387:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812748288 00000100:00100000:2.0:1787432607.169432:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787432607.169443:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:7666:x1874258812748288:12345-0@lo:101: 00010000:00010000:2.0:1787432607.169465:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432607.169479:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0f96f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f968 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.169504:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0f96f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f968 expref: 14 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.169515:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0f96f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f968 expref: 14 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.169525:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bb5210200, rc 0) 00000100:00100000:2.0:1787432607.169579:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:7666:x1874258812748288:12345-0@lo:101: Request processed in 138us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432607.169587:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787432607.169923:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812748288:0@lo:101: 00010000:00010000:0.0:1787432607.169940:0:7666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0f968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f96f expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.169950:0:7666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0f968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f96f expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432607.170073:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812748416:0@lo:501: 00000100:00100000:0.0:1787432607.170112:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432607.170147:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba81a000 going to sleep for 11 seconds 00000100:00100000:2.0:1787432607.170880:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812748416 00000100:00100000:2.0:1787432607.170887:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812748416 00000100:00100000:2.0:1787432607.170922:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787432607.170930:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:7666:x1874258812748416:12345-0@lo:501: 00000100:00100000:2.0:1787432607.171949:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:7666:x1874258812748416:12345-0@lo:501: Request processed in 1016us (1832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432607.171960:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787432607.172031:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812748416:0@lo:501: 00000100:00100000:2.0:1787432607.172078:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812748544:0@lo:503: 00000100:00100000:2.0:1787432607.172124:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432607.172162:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b911d0600 going to sleep for 11 seconds 00000100:00100000:0.0:1787432607.172884:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812748544 00000100:00100000:0.0:1787432607.172892:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812748544 00000100:00100000:0.0:1787432607.172940:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787432607.172950:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87904450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:7666:x1874258812748544:12345-0@lo:503: 00000100:00100000:0.0:1787432607.173149:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87904450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:7666:x1874258812748544:12345-0@lo:503: Request processed in 200us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432607.173156:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787432607.173855:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812748544:0@lo:503: 00000040:00080000:2.0:1787432607.174710:0:7666:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787432607.175012:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812748672:0@lo:502: 00000100:00100000:2.0:1787432607.175073:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432607.175112:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b911d0600 going to sleep for 11 seconds 00000100:00100000:3.0:1787432607.175158:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812748672 00000100:00100000:3.0:1787432607.175164:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812748672 00000100:00100000:3.0:1787432607.175472:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787432607.175483:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:7666:x1874258812748672:12345-0@lo:502: 00000100:00100000:3.0:1787432607.175793:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:7666:x1874258812748672:12345-0@lo:502: Request processed in 310us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432607.175801:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787432607.175957:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812748672:0@lo:502: 00000040:00080000:2.0:1787432607.176275:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787432607.176329:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787432607.176377:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787432607.176434:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787432607.176477:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787432607.176540:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787432607.176579:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787432607.176611:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787432607.176652:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787432607.176711:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787432607.177889:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787432607.177982:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787432607.178022:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787432607.178059:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787432607.178110:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787432607.178147:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787432607.178288:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787432607.178380:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787432607.178418:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787432607.178452:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787432607.178499:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787432607.178536:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787432607.178569:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787432607.178616:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787432607.178654:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787432607.178740:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787432607.178792:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787432607.178841:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787432607.178874:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787432607.178936:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787432607.178976:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787432607.179013:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787432607.179050:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787432607.179212:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787432607.179253:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787432607.179318:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787432607.179353:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787432607.179404:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812748800:0@lo:502: 00000100:00100000:2.0:1787432607.179484:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432607.180184:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b911d0600 going to sleep for 11 seconds 00000100:00100000:1.0:1787432607.180382:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812748800 00000100:00100000:1.0:1787432607.180392:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812748800 00000100:00100000:1.0:1787432607.180442:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787432607.180453:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87906c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:7666:x1874258812748800:12345-0@lo:502: 00000100:00100000:1.0:1787432607.181014:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87906c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:7666:x1874258812748800:12345-0@lo:502: Request processed in 561us (1528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432607.181022:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787432607.181140:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812748800:0@lo:502: 00000040:00080000:2.0:1787432607.181282:0:7666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1787432607.181297:0:7666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1787432607.182155:0:7678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787432607.182186:0:7678:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff935bbae78000) 00000020:00000080:2.0:1787432607.182209:0:7678:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1787432607.182490:0:7678:0:(tgt_mount.c:153:server_get_mount()) get mount ffff935bbb06d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787432607.182495:0:7678:0:(tgt_mount.c:187:server_put_mount()) put mount ffff935bbb06d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787432607.182498:0:7678:0:(obd_mount.c:710:lustre_put_lsi()) put ffff935bbb06d800 3 00010000:00080000:2.0:1787432607.182530:0:7678:0:(ldlm_lib.c:102:import_set_conn()) imp ffff935a85a83000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.115@tcp at head 00010000:00010000:2.0:1787432607.186056:0:7678:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1787432607.186645:0:7678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787432607.190679:0:7678:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787432607.190707:0:7678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbcb9e331c3f0f97d 00000100:00080000:2.0:1787432607.190720:0:7678:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787432607.191449:0:7678:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff935a85a83000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:2.0:1787432607.191501:0:7678:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff935bb9524a80 x1874258812748928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432607.191553:0:7678:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787432607.191684:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432607.191703:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874258812749056:0@lo:400: 00000100:00100000:3.0:1787432607.192647:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3329:1874258812748928:0@lo:38: 00000100:00100000:3.0:1787432607.192777:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432607.192851:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812748928 00000100:00100000:3.0:1787432607.192858:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812748928 00000100:00100000:3.0:1787432607.192895:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432607.192903:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3329:x1874258812748928:12345-0@lo:38: 00010000:00080000:3.0:1787432607.192931:0:5868:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:3.0:1787432607.192967:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbcb9e331c3f0f984 00000004:00100000:3.0:1787432607.192982:0:5868:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787432607.193015:0:5868:0:(import.c:65:import_set_state_nolock()) ffff935a8524c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787432607.193067:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3329:x1874258812748928:12345-0@lo:38: Request processed in 163us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432607.193074:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787432607.193114:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bb9524a80 x1874258812748928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432607.193125:0:3329:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787432607.193132:0:3329:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787432607.193141:0:3329:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787432607.193145:0:3329:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787432607.193147:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935a85a83000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787432607.193153:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3329:1874258812748928:0@lo:38: 00000100:00100000:2.0:1787432607.195533:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432607.195611:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432607.195634:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812749184:0@lo:400: 00000100:00100000:2.0:1787432607.195681:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432607.195713:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812749056 00000100:00100000:2.0:1787432607.195851:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812749056 00000100:00100000:2.0:1787432607.195898:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812749184 00000100:00100000:2.0:1787432607.195902:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812749184 00000100:00100000:2.0:1787432607.195932:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432607.195941:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874258812749056:12345-0@lo:400: 00000100:00100000:2.0:1787432607.195995:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874258812749056:12345-0@lo:400: Request processed in 55us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432607.196002:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432607.196020:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787432607.196027:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812749184:12345-0@lo:400: 00000100:00100000:2.0:1787432607.196058:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812749184:12345-0@lo:400: Request processed in 32us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432607.196064:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787432607.196080:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787432607.196117:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bb9525880 x1874258812749184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432607.196131:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812749184:0@lo:400: 00010000:00080000:2.0:1787432607.196161:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bb9526a00 x1874258812749056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432607.196193:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874258812749056:0@lo:400: 00000040:00080000:0.0:1787432607.205019:0:7678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1787432607.206772:0:7680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9526a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7680:1874258812749312:0@lo:901: 00000100:00100000:2.0:1787432607.206861:0:7680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432607.206907:0:7680:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b911d0540 going to sleep for 11 seconds 00000020:01000000:1.0:1787432607.207311:0:7666:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000100:00100000:0.0:1787432607.207468:0:5878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812749312 00000100:00100000:0.0:1787432607.207476:0:5878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812749312 00000100:00100000:0.0:1787432607.207548:0:5878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432607.207557:0:5878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7680:x1874258812749312:12345-0@lo:901: 10000000:01000000:1.0:1787432607.208507:0:7666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787432607.208525:0:7666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0f968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f96f expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432607.208538:0:7666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0f968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f96f expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787432607.208590:0:7666:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787432607.208592:0:7666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787432607.208593:0:7666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432607.208594:0:7666:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432607.208595:0:7666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432607.208597:0:7666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432607.208599:0:7666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787432607.208600:0:7666:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787432607.208602:0:7666:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787432607.208609:0:7666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432607.208610:0:7666:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787432607.208614:0:7666:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787432607.208616:0:7666:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787432607.208617:0:7666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787432607.208618:0:7666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432607.208619:0:7666:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432607.208620:0:7666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432607.208621:0:7666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432607.208622:0:7666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787432607.208623:0:7666:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787432607.208624:0:7666:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787432607.208624:0:7666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432607.208625:0:7666:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787432607.208648:0:7666:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787432607.208678:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812749440:0@lo:253: 00000100:00100000:0.0:1787432607.208814:0:5878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7680:x1874258812749312:12345-0@lo:901: Request processed in 517us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432607.208826:0:5878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787432607.208936:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787432607.208982:0:7680:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bb9526a00 x1874258812749312/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787432623 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432607.208997:0:7680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9526a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7680:1874258812749312:0@lo:901: 00000100:00100000:1.0:1787432607.209458:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432607.210947:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b874fe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432607.221911:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812749440 00000100:00100000:0.0:1787432607.221926:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812749440 00000100:00100000:0.0:1787432607.222094:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787432607.222113:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:7666:x1874258812749440:12345-0@lo:253: 20000000:01000000:0.0:1787432607.222153:0:5861:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787432607.222170:0:5861:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787432607.264547:0:5861:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787432607.264569:0:5861:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787432607.264688:0:5883:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787432607.264694:0:5883:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787432607.264742:0:5883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f98b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.264764:0:5883:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f8dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f8d5 expref: 14 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.264772:0:5883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f98b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.264813:0:5883:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f8dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f8d5 expref: 14 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432607.264828:0:5883:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f8dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f8d5 expref: 14 pid: 5861 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432607.264842:0:5883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5883:1874258812749568:0@lo:104: 00000100:00100000:0.0:1787432607.265046:0:5883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432607.265101:0:5883:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba0548480 going to sleep for 11 seconds 00000100:00100000:2.0:1787432607.267222:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812749568 00000100:00100000:2.0:1787432607.267239:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812749568 00000100:00100000:2.0:1787432607.267310:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432607.267321:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+3:5883:x1874258812749568:12345-0@lo:104: 00010000:00010000:2.0:1787432607.267350:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0f8d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f8dc expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.267442:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787432607.267449:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+3:5883:x1874258812749568:12345-0@lo:104: Request processed in 130us (2403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432607.267456:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787432607.267477:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432607.267483:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0f8d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f8dc expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.267491:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031400 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:2.0:1787432607.267507:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0f8d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f8dc expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.267516:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0f8d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f8dc expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432607.267524:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0f8d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f8dc expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432607.267530:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787432607.267562:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0f8d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f8dc expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.267568:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787432607.267582:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0f8d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f8dc expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.267589:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0f8d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f8dc expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.267605:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432607.267607:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432607.267608:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432607.267625:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812749696:0@lo:103: 00000100:00100000:2.0:1787432607.267694:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432607.267985:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812749696 00000100:00100000:2.0:1787432607.267991:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812749696 00010000:00010000:2.0:1787432607.268009:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f8dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f8d5 expref: 15 pid: 5861 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432607.268030:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432607.268042:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935ba07d6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:3333:x1874258812749696:12345-0@lo:103: 00010000:00010000:2.0:1787432607.268052:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432607.268057:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f8dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f8d5 expref: 15 pid: 5861 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.268067:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f8dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f8d5 expref: 15 pid: 5861 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.268084:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f98b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.268092:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f98b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787432607.268106:0:5853:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003413045s 00010000:00010000:2.0:1787432607.268110:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f98b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.268117:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f98b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.268124:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f98b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.268130:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f98b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.268136:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030400 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432607.268140:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f98b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.268421:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f98b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.268437:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f98b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.268447:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432607.268490:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935ba07d6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:3333:x1874258812749696:12345-0@lo:103: Request processed in 447us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432607.268497:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432607.268571:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812749696:0@lo:103: 00010000:00010000:2.0:1787432607.268776:0:5883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bb5210600/0xbcb9e331c3f0f8dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f8d5 expref: 14 pid: 5861 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432607.268789:0:5883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5883:1874258812749568:0@lo:104: 00010000:00010000:2.0:1787432607.268804:0:5883:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f98b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.268812:0:5883:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f98b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.268818:0:5883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f98b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432607.268825:0:5883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0f98b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432607.276284:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:7666:1874258812749440:0@lo:253: 10000000:01000000:0.0:1787432607.276308:0:7666:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787432607.276311:0:7666:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787432607.276313:0:7666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787432607.276314:0:7666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787432607.276316:0:7666:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787432607.276317:0:7666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787432607.276318:0:7666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787432607.276320:0:7666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787432607.276322:0:7666:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787432607.276323:0:7666:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787432607.276325:0:7666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787432607.276326:0:7666:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787432607.276413:0:7666:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1787432607.277984:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:7666:x1874258812749440:12345-0@lo:253: Request processed in 54059us (66704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432607.278005:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00080000:10000000:2.0:1787432607.289484:0:7666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787432607.289938:0:7666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787432607.290140:0:7666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787432607.290500:0:7666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787432607.291083:0:7666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787432607.291561:0:7666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787432607.293288:0:7666:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787432607.584531:0:7666:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787432607.584539:0:7666:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787432607.584573:0:7666:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787432607.584634:0:7666:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.115@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787432607.584648:0:7666:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787432607.584704:0:7666:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787432607.862457:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432608.887881:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432609.910861:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432610.936077:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432611.574840:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812749824:0@lo:13: 00000100:00100000:2.0:1787432611.574913:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432611.575038:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812749824 00000100:00100000:0.0:1787432611.575047:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812749824 00000100:00100000:0.0:1787432611.575110:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432611.575121:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812749824:12345-0@lo:13: 00002000:00000024:0.0:1787432611.575159:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787432611.575206:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812749824:12345-0@lo:13: Request processed in 87us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432611.575213:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787432611.575348:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787432611.575380:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bba0ab480 x1874258812749824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432611.575397:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812749824:0@lo:13: 00010000:00010000:1.0:1787432611.957887:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432612.604205:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432612.604245:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812749952:0@lo:400: 00000100:00100000:1.0:1787432612.604316:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432612.604382:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812749952 00000100:00100000:1.0:1787432612.604391:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812749952 00000100:00100000:1.0:1787432612.604436:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787432612.604446:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:3330:x1874258812749952:12345-0@lo:400: 00000100:00100000:1.0:1787432612.604496:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:3330:x1874258812749952:12345-0@lo:400: Request processed in 50us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432612.604511:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787432612.604562:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812749952:0@lo:400: 00000100:00100000:1.0:1787432612.604604:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812750080:0@lo:400: 00000100:00100000:1.0:1787432612.604631:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432612.604681:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812750080 00000100:00100000:1.0:1787432612.604685:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812750080 00000100:00100000:1.0:1787432612.604711:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787432612.604719:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812750080:12345-0@lo:400: 00000100:00100000:1.0:1787432612.604752:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812750080:12345-0@lo:400: Request processed in 35us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432612.604758:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787432612.604786:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935a84b46300 x1874258812750080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432612.604797:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812750080:0@lo:400: 00000100:00100000:1.0:1787432612.604826:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812750208:0@lo:400: 00000100:00100000:1.0:1787432612.604848:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432612.604875:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812750208 00000100:00100000:1.0:1787432612.604879:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812750208 00000100:00100000:1.0:1787432612.604909:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787432612.604915:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812750208:12345-0@lo:400: 00000100:00100000:1.0:1787432612.604945:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812750208:12345-0@lo:400: Request processed in 30us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432612.604951:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787432612.604966:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787432612.604982:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935a84b46300 x1874258812750208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432612.604999:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812750208:0@lo:400: 00000100:00100000:1.0:1787432612.605031:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812750336:0@lo:400: 00000100:00100000:1.0:1787432612.605057:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432612.605086:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812750336 00000100:00100000:1.0:1787432612.605090:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812750336 00000100:00100000:1.0:1787432612.605115:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432612.605121:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812750336:12345-0@lo:400: 00000100:00100000:1.0:1787432612.605150:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812750336:12345-0@lo:400: Request processed in 29us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432612.605155:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787432612.605177:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935a84b46300 x1874258812750336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432612.605186:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812750336:0@lo:400: 00000100:00100000:1.0:1787432612.605220:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432612.605226:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812750464:0@lo:400: 00000100:00100000:1.0:1787432612.605250:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432612.605268:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812750464 00000100:00100000:1.0:1787432612.605271:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812750464 00000100:00100000:1.0:1787432612.605292:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787432612.605297:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812750464:12345-0@lo:400: 00000100:00100000:1.0:1787432612.605326:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812750464:12345-0@lo:400: Request processed in 28us (75us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432612.605331:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787432612.605344:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787432612.605359:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935a84b46300 x1874258812750464/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432612.605375:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812750464:0@lo:400: 00010000:00010000:0.0:1787432612.981855:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432614.006984:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787432614.544777:0:8021:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787432615.045950:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432616.055124:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787432616.182262:0:5864:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787432616.182270:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff935bbb3e4800 from 30 10000000:01000000:3.0:1787432616.182276:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787432616.182319:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2155c00/0xbcb9e331c3f0f992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432616.182345:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bc2155c00/0xbcb9e331c3f0f992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432616.182357:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bc2155c00/0xbcb9e331c3f0f992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432616.182415:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86833100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812750592:0@lo:101: 00000100:00100000:3.0:1787432616.182568:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432616.182722:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432616.182808:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812750592 00000100:00100000:1.0:1787432616.182818:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812750592 00000100:00100000:1.0:1787432616.182903:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787432616.182914:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87905c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:5864:x1874258812750592:12345-0@lo:101: 00010000:00010000:1.0:1787432616.182927:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432616.182940:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bc2167200/0xbcb9e331c3f0f999 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f992 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.182976:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bc2167200/0xbcb9e331c3f0f999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f992 expref: 14 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.182986:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bc2167200/0xbcb9e331c3f0f999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f992 expref: 14 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.182994:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2167200, rc 0) 00000100:00100000:1.0:1787432616.183034:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87905c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:5864:x1874258812750592:12345-0@lo:101: Request processed in 122us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432616.183041:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787432616.183887:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86833100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812750592:0@lo:101: 00010000:00010000:3.0:1787432616.183909:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bc2155c00/0xbcb9e331c3f0f992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f999 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432616.183919:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bc2155c00/0xbcb9e331c3f0f992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f999 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432616.183981:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86833100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812750720:0@lo:501: 00000100:00100000:3.0:1787432616.184018:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432616.184057:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432616.184109:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812750720 00000100:00100000:1.0:1787432616.184114:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812750720 00000100:00100000:1.0:1787432616.184149:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787432616.184166:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87904050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:5864:x1874258812750720:12345-0@lo:501: 00000100:00100000:1.0:1787432616.184721:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87904050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:5864:x1874258812750720:12345-0@lo:501: Request processed in 563us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432616.184730:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787432616.185707:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86833100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812750720:0@lo:501: 00000100:00100000:3.0:1787432616.185760:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86833100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812750848:0@lo:503: 00000100:00100000:3.0:1787432616.185814:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432616.185845:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432616.185947:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812750848 00000100:00100000:2.0:1787432616.185954:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812750848 00000100:00100000:2.0:1787432616.186000:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787432616.186008:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87905850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:5864:x1874258812750848:12345-0@lo:503: 00000100:00100000:2.0:1787432616.186583:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87905850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:5864:x1874258812750848:12345-0@lo:503: Request processed in 574us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432616.186590:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787432616.194279:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86833100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812750848:0@lo:503: 00000100:00100000:3.0:1787432616.194611:0:8098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86833100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8098:1874258812750976:0@lo:502: 00000100:00100000:3.0:1787432616.194718:0:8098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432616.194759:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812750976 00000100:00100000:3.0:1787432616.194766:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812750976 00000100:00100000:3.0:1787432616.194815:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787432616.194824:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:8098:x1874258812750976:12345-0@lo:502: 00000100:00100000:3.0:1787432616.196413:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:8098:x1874258812750976:12345-0@lo:502: Request processed in 1585us (1690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432616.196424:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787432616.196562:0:8098:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432616.196588:0:8098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86833100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8098:1874258812750976:0@lo:502: 00000100:00100000:3.0:1787432616.196652:0:8098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86833100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8098:1874258812751104:0@lo:502: 00000100:00100000:3.0:1787432616.196717:0:8098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432616.196740:0:8098:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432616.196822:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812751104 00000100:00100000:2.0:1787432616.196829:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812751104 00000100:00100000:2.0:1787432616.196871:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787432616.196880:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:8098:x1874258812751104:12345-0@lo:502: 00000100:00100000:2.0:1787432616.197063:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:8098:x1874258812751104:12345-0@lo:502: Request processed in 184us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432616.197070:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787432616.198874:0:8098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86833100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8098:1874258812751104:0@lo:502: 00000040:00080000:3.0:1787432616.198920:0:8098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787432616.199872:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787432616.199895:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787432616.199918:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2155c00/0xbcb9e331c3f0f992 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f999 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432616.199929:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bc2155c00/0xbcb9e331c3f0f992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f999 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432616.199939:0:5864:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787432616.199942:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787432616.199944:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787432616.199982:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bb5210600/0xbcb9e331c3f0f9a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432616.199990:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bb5210600/0xbcb9e331c3f0f9a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432616.199999:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bb5210600/0xbcb9e331c3f0f9a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432616.200020:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9527800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812751232:0@lo:101: 00000100:00100000:2.0:1787432616.200084:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432616.200588:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a85036000 going to sleep for 11 seconds 00000100:00100000:3.0:1787432616.206261:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812751232 00000100:00100000:3.0:1787432616.206276:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812751232 00000100:00100000:2.0:1787432616.207946:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787432616.207958:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:5864:x1874258812751232:12345-0@lo:101: 00010000:00010000:2.0:1787432616.207977:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432616.207996:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0f9a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f9a0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432616.208028:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0f9a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f9a0 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432616.208054:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0f9a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f9a0 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432616.208064:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bb5211600, rc 0) 00000100:00100000:2.0:1787432616.208312:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:5864:x1874258812751232:12345-0@lo:101: Request processed in 201us (8072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432616.208322:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787432616.208384:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9527800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812751232:0@lo:101: 00010000:00010000:2.0:1787432616.208402:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bb5210600/0xbcb9e331c3f0f9a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f9a7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432616.208411:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bb5210600/0xbcb9e331c3f0f9a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f9a7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432616.208497:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9527800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812751360:0@lo:501: 00000100:00100000:2.0:1787432616.208532:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432616.208599:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a85036000 going to sleep for 11 seconds 00000100:00100000:0.0:1787432616.209542:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812751360 00000100:00100000:0.0:1787432616.209552:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812751360 00000100:00100000:0.0:1787432616.209633:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787432616.209643:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:5864:x1874258812751360:12345-0@lo:501: 00000100:00100000:0.0:1787432616.209961:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:5864:x1874258812751360:12345-0@lo:501: Request processed in 319us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432616.209969:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787432616.210605:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9527800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812751360:0@lo:501: 00000100:00100000:2.0:1787432616.210653:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9527800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812751488:0@lo:503: 00000100:00100000:2.0:1787432616.210717:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432616.216396:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a85036000 going to sleep for 11 seconds 00000100:00100000:3.0:1787432616.216923:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812751488 00000100:00100000:3.0:1787432616.216933:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812751488 00000100:00100000:3.0:1787432616.216982:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787432616.216993:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87906850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:5864:x1874258812751488:12345-0@lo:503: 00000100:00100000:2.0:1787432616.217600:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9527800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812751488:0@lo:503: 00000100:00100000:2.0:1787432616.217811:0:8102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9527800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8102:1874258812751616:0@lo:502: 00000100:00100000:3.0:1787432616.217884:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87906850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:5864:x1874258812751488:12345-0@lo:503: Request processed in 891us (7164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432616.217892:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787432616.220325:0:8102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432616.220378:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812751616 00000100:00100000:2.0:1787432616.220387:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812751616 00000100:00100000:2.0:1787432616.220434:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787432616.220512:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:8102:x1874258812751616:12345-0@lo:502: 00000100:00100000:2.0:1787432616.221047:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:8102:x1874258812751616:12345-0@lo:502: Request processed in 604us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432616.221055:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787432616.221604:0:8102:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a850363c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432616.221633:0:8102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9527800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8102:1874258812751616:0@lo:502: 00000020:01000000:2.0:1787432616.222268:0:8102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432616.222279:0:8102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432616.222281:0:8102:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787432616.222287:0:8102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787432616.222289:0:8102:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787432616.222322:0:8102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9527800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8102:1874258812751744:0@lo:502: 00000100:00100000:2.0:1787432616.222379:0:8102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432616.222414:0:8102:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a850363c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432616.222563:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812751744 00000100:00100000:0.0:1787432616.222569:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812751744 00000100:00100000:0.0:1787432616.222617:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787432616.222627:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:8102:x1874258812751744:12345-0@lo:502: 00000100:00100000:0.0:1787432616.222836:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:8102:x1874258812751744:12345-0@lo:502: Request processed in 209us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432616.222843:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787432616.222943:0:8102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9527800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8102:1874258812751744:0@lo:502: 00000020:01000000:2.0:1787432616.222967:0:8102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432616.222971:0:8102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432616.222972:0:8102:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787432616.222976:0:8102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787432616.225761:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787432616.225805:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787432616.225816:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bb5210600/0xbcb9e331c3f0f9a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f9a7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432616.225827:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bb5210600/0xbcb9e331c3f0f9a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f9a7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432616.225836:0:5864:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787432616.225839:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff935b90e92000 from 30 10000000:01000000:0.0:1787432616.225842:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787432616.225877:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f9ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432616.225886:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f9ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432616.225896:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f9ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432616.225919:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812751872:0@lo:101: 00000100:00100000:0.0:1787432616.225978:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432616.226058:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b878c4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432616.228840:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812751872 00000100:00100000:3.0:1787432616.228854:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812751872 00000100:00100000:3.0:1787432616.229542:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787432616.229563:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:5864:x1874258812751872:12345-0@lo:101: 00010000:00010000:3.0:1787432616.229581:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432616.229599:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bc2154800/0xbcb9e331c3f0f9b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f9ae expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432616.229635:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bc2154800/0xbcb9e331c3f0f9b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f9ae expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432616.229647:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bc2154800/0xbcb9e331c3f0f9b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f9ae expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432616.229692:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154800, rc 0) 00000100:00100000:3.0:1787432616.229770:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:5864:x1874258812751872:12345-0@lo:101: Request processed in 209us (3791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432616.229777:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787432616.229878:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812751872:0@lo:101: 00010000:00010000:1.0:1787432616.229896:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f9ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f9b5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.229905:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f9ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f9b5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432616.229970:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812752000:0@lo:501: 00000100:00100000:1.0:1787432616.229998:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432616.230852:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b875eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432616.231018:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812752000 00000100:00100000:0.0:1787432616.231025:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812752000 00000100:00100000:0.0:1787432616.231059:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787432616.231068:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:5864:x1874258812752000:12345-0@lo:501: 00000100:00100000:0.0:1787432616.231408:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:5864:x1874258812752000:12345-0@lo:501: Request processed in 340us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432616.231416:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787432616.233231:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812752000:0@lo:501: 00000100:00100000:1.0:1787432616.233285:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812752128:0@lo:503: 00000100:00100000:1.0:1787432616.233363:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432616.233393:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b875eecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432616.233415:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812752128 00000100:00100000:1.0:1787432616.233420:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812752128 00000100:00100000:1.0:1787432616.233580:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787432616.233602:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:5864:x1874258812752128:12345-0@lo:503: 00000100:00100000:1.0:1787432616.233815:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:5864:x1874258812752128:12345-0@lo:503: Request processed in 215us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432616.233822:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787432616.233870:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812752128:0@lo:503: 00000100:00100000:3.0:1787432616.235977:0:8104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86833100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8104:1874258812752256:0@lo:502: 00000100:00100000:3.0:1787432616.236054:0:8104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432616.236311:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812752256 00000100:00100000:1.0:1787432616.236318:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812752256 00000100:00100000:1.0:1787432616.236363:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787432616.236373:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:8104:x1874258812752256:12345-0@lo:502: 00000100:00100000:1.0:1787432616.236824:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:8104:x1874258812752256:12345-0@lo:502: Request processed in 451us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432616.236833:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787432616.237069:0:8104:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787432616.237103:0:8104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86833100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8104:1874258812752256:0@lo:502: 00000100:00100000:3.0:1787432616.237238:0:8104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86833100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8104:1874258812752384:0@lo:502: 00000100:00100000:3.0:1787432616.237282:0:8104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432616.237346:0:8104:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432616.237642:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812752384 00000100:00100000:2.0:1787432616.237648:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812752384 00000100:00100000:1.0:1787432616.242258:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787432616.242279:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:8104:x1874258812752384:12345-0@lo:502: 00000100:00100000:1.0:1787432616.242796:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:8104:x1874258812752384:12345-0@lo:502: Request processed in 523us (5511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432616.242805:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787432616.243019:0:8104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86833100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8104:1874258812752384:0@lo:502: 00000040:00080000:0.0:1787432616.243068:0:8104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787432616.243300:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787432616.243320:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787432616.243330:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f9ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f9b5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.243342:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f9b5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432616.243352:0:5864:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787432616.243355:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff935b90e92000 from 5 10000000:01000000:1.0:1787432616.243358:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787432616.243393:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2166400/0xbcb9e331c3f0f9bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.243400:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bc2166400/0xbcb9e331c3f0f9bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.243409:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bc2166400/0xbcb9e331c3f0f9bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432616.243426:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812752512:0@lo:101: 00000100:00100000:1.0:1787432616.243482:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432616.243513:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b875ee0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432616.243529:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812752512 00000100:00100000:1.0:1787432616.243535:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812752512 00000100:00100000:1.0:1787432616.243568:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787432616.243576:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:5864:x1874258812752512:12345-0@lo:101: 00010000:00010000:1.0:1787432616.243585:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432616.243597:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bc2167c00/0xbcb9e331c3f0f9c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f9bc expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.243618:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bc2167c00/0xbcb9e331c3f0f9c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f9bc expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.243640:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bc2167c00/0xbcb9e331c3f0f9c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f9bc expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.243648:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2167c00, rc 0) 00000100:00100000:1.0:1787432616.243704:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812752512:12345-0@lo:101: Request processed in 129us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432616.243710:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787432616.243744:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812752512:0@lo:101: 00010000:00010000:1.0:1787432616.243756:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bc2166400/0xbcb9e331c3f0f9bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f9c3 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.243766:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bc2166400/0xbcb9e331c3f0f9bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f9c3 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432616.243808:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812752640:0@lo:256: 00000100:00100000:1.0:1787432616.243847:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432616.243860:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b875ee0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432616.243871:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812752640 00000100:00100000:1.0:1787432616.243873:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812752640 00000100:00100000:1.0:1787432616.243891:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787432616.243897:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812752640:12345-0@lo:256: 20000000:01000000:1.0:1787432616.243909:0:5861:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787432616.243925:0:5861:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787432616.243928:0:5861:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787432616.243999:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812752640:12345-0@lo:256: Request processed in 102us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432616.244008:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787432616.244035:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812752640:0@lo:256: 10000000:01000000:1.0:1787432616.244075:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787432616.244080:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2166400/0xbcb9e331c3f0f9bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f9c3 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.244101:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bc2166400/0xbcb9e331c3f0f9bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f9c3 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432616.244109:0:5864:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787432616.244110:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1787432616.244112:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787432616.244127:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2167a00/0xbcb9e331c3f0f9ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.244135:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bc2167a00/0xbcb9e331c3f0f9ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.244151:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bc2167a00/0xbcb9e331c3f0f9ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432616.244423:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812752768:0@lo:101: 00000100:00100000:1.0:1787432616.244520:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432616.244538:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b875ee0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432616.244554:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812752768 00000100:00100000:1.0:1787432616.244557:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812752768 00000100:00100000:1.0:1787432616.244582:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787432616.244588:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812752768:12345-0@lo:101: 00010000:00010000:1.0:1787432616.244596:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432616.244605:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bc2167400/0xbcb9e331c3f0f9d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f9ca expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.244698:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bc2167400/0xbcb9e331c3f0f9d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f9ca expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.244709:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bc2167400/0xbcb9e331c3f0f9d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f9ca expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.244718:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2167400, rc 0) 00000100:00100000:1.0:1787432616.244750:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812752768:12345-0@lo:101: Request processed in 162us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432616.244755:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787432616.244789:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812752768:0@lo:101: 00010000:00010000:1.0:1787432616.244798:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bc2167a00/0xbcb9e331c3f0f9ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f9d1 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.244815:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bc2167a00/0xbcb9e331c3f0f9ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f9d1 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432616.244859:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812752896:0@lo:501: 00000100:00100000:1.0:1787432616.244883:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432616.244896:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b875ee0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432616.244906:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812752896 00000100:00100000:1.0:1787432616.244909:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812752896 00000100:00100000:1.0:1787432616.244929:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787432616.244935:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812752896:12345-0@lo:501: 00000100:00100000:1.0:1787432616.246015:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812752896:12345-0@lo:501: Request processed in 1074us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432616.246024:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787432616.246072:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812752896:0@lo:501: 00000100:00100000:1.0:1787432616.246119:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812753024:0@lo:503: 00000100:00100000:1.0:1787432616.246228:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432616.246252:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b875ee0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432616.246267:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812753024 00000100:00100000:1.0:1787432616.246271:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812753024 00000100:00100000:1.0:1787432616.246303:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787432616.246311:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812753024:12345-0@lo:503: 00000100:00100000:1.0:1787432616.246791:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812753024:12345-0@lo:503: Request processed in 480us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432616.246799:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787432616.246844:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812753024:0@lo:503: 00000100:00100000:0.0:1787432616.248529:0:8105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8105:1874258812753152:0@lo:502: 00000100:00100000:0.0:1787432616.248601:0:8105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432616.248654:0:8105:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b878c4000 going to sleep for 11 seconds 00000100:00100000:1.0:1787432616.249559:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812753152 00000100:00100000:1.0:1787432616.249569:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812753152 00000100:00100000:1.0:1787432616.249633:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787432616.249645:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:8105:x1874258812753152:12345-0@lo:502: 00000100:00100000:1.0:1787432616.249997:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:8105:x1874258812753152:12345-0@lo:502: Request processed in 353us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432616.250005:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787432616.250213:0:8105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8105:1874258812753152:0@lo:502: 00000020:01000000:0.0:1787432616.250253:0:8105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787432616.250262:0:8105:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787432616.250269:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432616.250272:0:8105:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787432616.250278:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787432616.250282:0:8105:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.115@tcp to nid 0x20000c0a8ca73 (192.168.202.115@tcp) 00000020:01000000:0.0:1787432616.250308:0:8105:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787432616.250311:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787432616.250329:0:8105:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff935b91a84d28) 00000020:00000080:0.0:1787432616.250356:0:8105:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787432616.250362:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787432616.251536:0:8105:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787432616.251544:0:8105:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787432616.251552:0:8105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbcb9e331c3f0f9df 00010000:00080000:0.0:1787432616.251581:0:8105:0:(ldlm_lib.c:102:import_set_conn()) imp ffff935b9089b800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.115@tcp at head 00010000:00010000:0.0:1787432616.251785:0:8105:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787432616.252115:0:8105:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787432616.252129:0:8105:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787432616.253104:0:8105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787432616.253345:0:8105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787432616.253397:0:8105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787432616.260580:0:8105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787432616.261829:0:8107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787432616.261835:0:8107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787432616.264933:0:8105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787432616.264949:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787432616.264988:0:8105:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787432616.265013:0:8105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbcb9e331c3f0f9e6 00000100:00080000:3.0:1787432616.265024:0:8105:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787432616.265030:0:8105:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff935b9089b800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:3.0:1787432616.265076:0:8105:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff935b86830000 x1874258812753280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787432616.265101:0:8105:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1787432616.265215:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812753408:0@lo:400: 00000100:00100000:3.0:1787432616.265281:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432616.265319:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787432616.265325:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3332:1874258812753536:0@lo:400: 00000100:00100000:3.0:1787432616.265347:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432616.265377:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812753664:0@lo:400: 00000100:00100000:3.0:1787432616.265403:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432616.265422:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432616.265427:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812753792:0@lo:400: 00000100:00100000:2.0:1787432616.265746:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812753280:0@lo:8: 00000100:00100000:0.0:1787432616.267333:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812753408 00000100:00100000:0.0:1787432616.267353:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812753408 00000100:00100000:0.0:1787432616.267414:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812753536 00000100:00100000:0.0:1787432616.267418:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812753536 00000100:00100000:0.0:1787432616.267452:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787432616.267463:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812753408:12345-0@lo:400: 00000100:00100000:1.0:1787432616.267634:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787432616.267644:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1874258812753536:12345-0@lo:400: 00000100:00100000:2.0:1787432616.267867:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432616.268000:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812753664 00000100:00100000:2.0:1787432616.268004:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812753664 00000100:00100000:2.0:1787432616.268036:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812753280 00000100:00100000:2.0:1787432616.268047:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812753280 00000100:00100000:2.0:1787432616.268063:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787432616.268070:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812753664:12345-0@lo:400: 00000100:00100000:2.0:1787432616.268105:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812753664:12345-0@lo:400: Request processed in 37us (2700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432616.268111:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787432616.268128:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787432616.268133:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3329:x1874258812753280:12345-0@lo:8: 00010000:00080000:2.0:1787432616.268156:0:6725:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:2.0:1787432616.268194:0:6725:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbcb9e331c3f0f9ed 00002000:00100000:2.0:1787432616.268208:0:6725:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff935a85a82800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787432616.268213:0:6725:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787432616.268216:0:6725:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787432616.268340:0:6725:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787432616.268531:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787432616.268569:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935b86831c00 x1874258812753664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432616.268583:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812753664:0@lo:400: 00000100:00100000:3.0:1787432616.268611:0:5869:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787432616.268631:0:5869:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1787432616.268653:0:6929:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787432616.268679:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812753792 00000100:00100000:3.0:1787432616.268683:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812753792 00000100:00100000:3.0:1787432616.268704:0:6929:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787432616.268710:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787432616.268716:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812753792:12345-0@lo:400: 00000100:00100000:3.0:1787432616.268756:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812753792:12345-0@lo:400: Request processed in 40us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432616.268762:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787432616.268923:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935b86833b80 x1874258812753792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432616.268934:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812753792:0@lo:400: 00002000:00080000:2.0:1787432616.269297:0:6725:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787432616.269322:0:6725:0:(import.c:65:import_set_state_nolock()) ffff935a85a81000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432616.269378:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3329:x1874258812753280:12345-0@lo:8: Request processed in 1243us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432616.269782:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432616.269951:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812753408:12345-0@lo:400: Request processed in 2488us (4667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432616.269959:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000020:01000000:0.0:1787432616.270049:0:8105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432616.270056:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432616.270059:0:8105:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787432616.270062:0:8105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432616.270066:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432616.270068:0:8105:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787432616.270071:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787432616.270073:0:8105:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787432616.270108:0:8105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8105:1874258812753920:0@lo:502: 00000100:00100000:0.0:1787432616.270161:0:8105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432616.270204:0:8105:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b878c40c0 going to sleep for 11 seconds 00010000:00080000:3.0:1787432616.270316:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935b86830000 x1874258812753280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787432626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432616.270326:0:3329:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787432616.270332:0:3329:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787432616.270341:0:3329:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787432616.270346:0:3329:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787432616.270349:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935b9089b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787432616.270366:0:3329:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787432616.270371:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812753280:0@lo:8: 00000004:00080000:0.0:1787432616.270427:0:8107:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787432616.270563:0:8107:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 250935904428ns, next at 0ns, rc = 0 00010000:00080000:2.0:1787432616.272557:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935b86833480 x1874258812753408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432616.272576:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812753408:0@lo:400: 00000100:00080000:0.0:1787432616.276406:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787432616.276413:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432616.276799:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812753920 00000100:00100000:1.0:1787432616.276811:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812753920 00000100:00100000:1.0:1787432616.277002:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787432616.277014:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:8105:x1874258812753920:12345-0@lo:502: 00000100:00100000:1.0:1787432616.277296:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:8105:x1874258812753920:12345-0@lo:502: Request processed in 284us (7134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432616.277304:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787432616.277375:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1874258812753536:12345-0@lo:400: Request processed in 9732us (12025us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432616.277383:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787432616.277426:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935b86830380 x1874258812753536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432616.279922:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3332:1874258812753536:0@lo:400: 00000100:00100000:1.0:1787432616.280885:0:8105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8105:1874258812753920:0@lo:502: 00000020:01000000:1.0:1787432616.280937:0:8105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432616.280952:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432616.280955:0:8105:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787432616.280962:0:8105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1787432616.281934:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787432616.281957:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787432616.281968:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2167a00/0xbcb9e331c3f0f9ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f9d1 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432616.281992:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bc2167a00/0xbcb9e331c3f0f9ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f9d1 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432616.283390:0:5864:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787432616.283396:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff935b879b0000 from 1 10000000:01000000:1.0:1787432616.283400:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787432616.283706:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba417400/0xbcb9e331c3f0f9f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.283719:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bba417400/0xbcb9e331c3f0f9f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.283731:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bba417400/0xbcb9e331c3f0f9f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432616.283758:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812754048:0@lo:101: 00000100:00100000:1.0:1787432616.283858:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432616.283903:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87dc2240 going to sleep for 11 seconds 00000100:00100000:0.0:1787432616.284307:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812754048 00000100:00100000:0.0:1787432616.284315:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812754048 00000100:00100000:0.0:1787432616.284413:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787432616.284424:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812754048:12345-0@lo:101: 00010000:00010000:0.0:1787432616.284437:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432616.284460:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935b80030000/0xbcb9e331c3f0f9fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0f9f4 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432616.284501:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935b80030000/0xbcb9e331c3f0f9fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f9f4 expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432616.284513:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935b80030000/0xbcb9e331c3f0f9fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f9f4 expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432616.284522:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80030000, rc 0) 00000100:00100000:0.0:1787432616.284573:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812754048:12345-0@lo:101: Request processed in 151us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432616.284579:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787432616.284921:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812754048:0@lo:101: 00010000:00010000:1.0:1787432616.284940:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bba417400/0xbcb9e331c3f0f9f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f9fb expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.284999:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bba417400/0xbcb9e331c3f0f9f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f9fb expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432616.285060:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812754176:0@lo:501: 00000100:00100000:1.0:1787432616.285107:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432616.285727:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87dc2240 going to sleep for 11 seconds 00000100:00100000:3.0:1787432616.285917:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812754176 00000100:00100000:3.0:1787432616.285923:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812754176 00000100:00100000:3.0:1787432616.285956:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787432616.285965:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812754176:12345-0@lo:501: 00000100:00100000:3.0:1787432616.286411:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812754176:12345-0@lo:501: Request processed in 445us (1301us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787432616.286419:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787432616.287160:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812754176:0@lo:501: 10000000:01000000:1.0:1787432616.287221:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787432616.287231:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba417400/0xbcb9e331c3f0f9f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f9fb expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432616.287240:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bba417400/0xbcb9e331c3f0f9f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f9fb expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787432616.307267:0:5889:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787432616.344001:0:8108:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787432616.344052:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0aa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8108:1874258812754432:0@lo:7: 00000100:00100000:0.0:1787432616.344147:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432616.344184:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba0793b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432616.344211:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787432616.344222:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812754304:0@lo:13: 00000100:00100000:0.0:1787432616.344245:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432616.344271:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812754432 00000100:00100000:0.0:1787432616.344276:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812754432 00000100:00100000:0.0:1787432616.344326:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787432616.344335:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8108:x1874258812754432:12345-0@lo:7: 00000100:00100000:1.0:1787432616.347256:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812754304 00000100:00100000:1.0:1787432616.347383:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812754304 00000100:00100000:1.0:1787432616.347822:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787432616.347831:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3333:x1874258812754304:12345-0@lo:13: 00002000:00000024:1.0:1787432616.347862:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787432616.347957:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3333:x1874258812754304:12345-0@lo:13: Request processed in 128us (3710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432616.347965:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787432616.357638:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bba0a8e00 x1874258812754304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432616.357675:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812754304:0@lo:13: 00002000:00080000:0.0:1787432616.358883:0:6726:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787432616.358890:0:6726:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787432616.358985:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8108:x1874258812754432:12345-0@lo:7: Request processed in 14647us (14835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432616.358995:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787432616.359027:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787432616.359595:0:8108:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bba0aa680 x1874258812754432/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787432632 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432616.359612:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0aa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8108:1874258812754432:0@lo:7: 00000004:00080000:1.0:1787432616.359625:0:8108:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787432616.359680:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8108:1874258812754560:0@lo:5: 00000100:00100000:1.0:1787432616.359716:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432616.359750:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87b73240 going to sleep for 11 seconds 00000100:00100000:1.0:1787432616.359768:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812754560 00000100:00100000:1.0:1787432616.359780:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812754560 00000100:00100000:1.0:1787432616.359821:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787432616.359829:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8108:x1874258812754560:12345-0@lo:5: 00002000:00080000:1.0:1787432616.359852:0:6724:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787432616.359855:0:6724:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00010000:00080000:0.0:1787432616.360564:0:8108:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935a84b46300 x1874258812754560/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787432632 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432616.360577:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8108:1874258812754560:0@lo:5: 00000004:00080000:0.0:1787432616.360588:0:8108:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787432616.360613:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8108:1874258812754688:0@lo:700: 00000100:00100000:0.0:1787432616.360640:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432616.360672:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba0793c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432616.360686:0:6732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812754688 00000100:00100000:0.0:1787432616.360690:0:6732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812754688 00000100:00100000:0.0:1787432616.360724:0:6732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432616.360731:0:6732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+8:8108:x1874258812754688:12345-0@lo:700: 00000100:00100000:0.0:1787432616.360758:0:6732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6732:1874258812754816:0@lo:700: 00000100:00100000:0.0:1787432616.360787:0:6732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432616.360805:0:6732:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba0793780 going to sleep for 11 seconds 00000100:00100000:0.0:1787432616.360825:0:5874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812754816 00000100:00100000:0.0:1787432616.360828:0:5874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812754816 00000100:00100000:0.0:1787432616.360855:0:5874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432616.360861:0:5874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6732:x1874258812754816:12345-0@lo:700: 00000100:00100000:1.0:1787432616.361538:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:8108:x1874258812754560:12345-0@lo:5: Request processed in 1706us (1816us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787432616.361547:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 40000000:02000000:0.0:1787432616.427158:0:5874:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787432616.439598:0:5874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6732:x1874258812754816:12345-0@lo:700: Request processed in 78729us (78802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432616.439613:0:5874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787432616.441330:0:6732:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bba0aa300 x1874258812754816/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787432632 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432616.441350:0:6732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6732:1874258812754816:0@lo:700: 40000000:02000000:1.0:1787432616.441366:0:6732:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1787432616.509614:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1787432616.509632:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787432616.509778:0:6732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8108:x1874258812754688:12345-0@lo:700: Request processed in 149041us (149131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432616.509790:0:6732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787432616.509924:0:8108:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bba0a9c00 x1874258812754688/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787432632 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432616.509946:0:8108:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787432616.509966:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8108:1874258812754688:0@lo:700: 00000004:02000040:0.0:1787432616.542955:0:8108:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1787432616.548897:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8108:1874258812754944:0@lo:5: 00000100:00100000:0.0:1787432616.549037:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432616.549153:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87b73240 going to sleep for 11 seconds 00000100:00100000:3.0:1787432616.549410:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812754944 00000100:00100000:3.0:1787432616.549419:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812754944 00000100:00100000:3.0:1787432616.549580:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432616.549590:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8108:x1874258812754944:12345-0@lo:5: 00002000:00080000:2.0:1787432616.556888:0:6726:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787432616.556909:0:6726:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1787432616.561150:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8108:x1874258812754944:12345-0@lo:5: Request processed in 11491us (12043us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787432616.561231:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787432616.561378:0:8108:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bba0a9c00 x1874258812754944/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787432632 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432616.561397:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8108:1874258812754944:0@lo:5: 00000004:00080000:0.0:1787432616.561413:0:8108:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1787432616.694101:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812755072:0@lo:13: 00000100:00100000:1.0:1787432616.694207:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432616.694853:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812755072 00000100:00100000:2.0:1787432616.694862:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812755072 00000100:00100000:2.0:1787432616.694916:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787432616.694926:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812755072:12345-0@lo:13: 00002000:00000024:2.0:1787432616.694963:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432616.696070:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812755072:12345-0@lo:13: Request processed in 1124us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432616.696087:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787432616.696850:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bba0a8a80 x1874258812755072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432616.696875:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812755072:0@lo:13: 00010000:00010000:1.0:1787432617.082571:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432618.101985:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432619.127765:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787432619.907000:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1787432620.157650:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432621.183408:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432621.302311:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812755200:0@lo:400: 00000100:00100000:3.0:1787432621.302397:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432621.303786:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812755200 00000100:00100000:3.0:1787432621.303812:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812755200 00000100:00100000:3.0:1787432621.303873:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787432621.303883:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812755200:12345-0@lo:400: 00000100:00100000:3.0:1787432621.303955:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812755200:12345-0@lo:400: Request processed in 73us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432621.303962:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787432621.304024:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812755200:0@lo:400: 00000100:00100000:3.0:1787432621.304110:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432621.304120:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874258812755328:0@lo:400: 00000100:00100000:3.0:1787432621.304163:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432621.304278:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812755328 00000100:00100000:2.0:1787432621.304283:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812755328 00000100:00100000:2.0:1787432621.304323:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787432621.304331:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874258812755328:12345-0@lo:400: 00000100:00100000:2.0:1787432621.304382:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874258812755328:12345-0@lo:400: Request processed in 52us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432621.304389:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787432621.304463:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935a84b44380 x1874258812755328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432621.304475:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874258812755328:0@lo:400: 00000100:00100000:2.0:1787432621.305889:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432621.306186:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812755584:0@lo:400: 00000100:00100000:2.0:1787432621.306240:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432621.306315:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812755456:0@lo:400: 00000100:00100000:2.0:1787432621.306339:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432621.306407:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812755456 00000100:00100000:3.0:1787432621.306414:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812755456 00000100:00100000:3.0:1787432621.306478:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787432621.306488:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812755456:12345-0@lo:400: 00000100:00100000:3.0:1787432621.306541:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812755456:12345-0@lo:400: Request processed in 54us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432621.306547:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787432621.306624:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935a84b45180 x1874258812755456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432621.306639:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812755456:0@lo:400: 00000100:00100000:1.0:1787432621.306835:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812755840:0@lo:400: 00000100:00100000:1.0:1787432621.306868:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787432621.306909:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432621.307035:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787432621.307155:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812755712:0@lo:400: 00000100:00100000:1.0:1787432621.307200:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432621.307332:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812755712 00000100:00100000:3.0:1787432621.307338:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812755712 00000100:00100000:3.0:1787432621.307390:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787432621.307397:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812755712:12345-0@lo:400: 00000100:00100000:3.0:1787432621.307438:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812755712:12345-0@lo:400: Request processed in 41us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432621.307454:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787432621.307516:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787432621.307538:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935a84b45c00 x1874258812755712/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432621.307550:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812755712:0@lo:400: 00000100:00100000:0.0:1787432621.307678:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812755584 00000100:00100000:0.0:1787432621.307683:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812755584 00000100:00100000:0.0:1787432621.307728:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812755840 00000100:00100000:0.0:1787432621.307731:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812755840 00000100:00100000:0.0:1787432621.307748:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432621.307758:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812755584:12345-0@lo:400: 00000100:00100000:0.0:1787432621.307799:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812755584:12345-0@lo:400: Request processed in 44us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432621.307805:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432621.307818:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787432621.307825:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812755840:12345-0@lo:400: 00000100:00100000:0.0:1787432621.307855:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812755840:12345-0@lo:400: Request processed in 31us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432621.307868:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787432621.307957:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935a84b44380 x1874258812755584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432621.307967:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812755584:0@lo:400: 00000100:00080000:1.0:1787432621.308018:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432621.308021:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787432621.308039:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935a84b46300 x1874258812755840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432621.308059:0:3331:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787432621.308070:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812755840:0@lo:400: 00000100:00100000:0.0:1787432621.615026:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432621.615149:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791760256 00000100:00100000:2.0:1787432621.615165:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791760256 00000100:00100000:2.0:1787432621.615234:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 113 00000100:00100000:2.0:1787432621.615244:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2374:x1874258791760256:12345-192.168.202.15@tcp:250: 00010000:00080000:2.0:1787432621.615273:0:5860:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ddbb8f34-e22a-4617-a2bc-6bdb0784521d@192.168.202.15@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:2.0:1787432621.615305:0:5860:0:(genops.c:1385:class_connect()) connect: client ddbb8f34-e22a-4617-a2bc-6bdb0784521d, cookie 0xbcb9e331c3f0fa02 00000100:00080000:2.0:1787432621.615457:0:5860:0:(import.c:65:import_set_state_nolock()) ffff935a85a82000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432621.615873:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+5:2374:x1874258791760256:12345-192.168.202.15@tcp:250: Request processed in 627us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432621.615881:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 113 00000100:00100000:0.0:1787432621.632510:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432621.632760:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791760128 00000100:00100000:1.0:1787432621.632774:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791760128 00000100:00100000:1.0:1787432621.632851:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 114 00000100:00100000:1.0:1787432621.632862:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+5:5605:x1874258791760128:12345-192.168.202.15@tcp:101: 00010000:00010000:1.0:1787432621.632885:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432621.632908:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba417600/0xbcb9e331c3f0fa09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a025ab0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432621.632947:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba417600/0xbcb9e331c3f0fa09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ab0 expref: 6 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432621.632961:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba417600/0xbcb9e331c3f0fa09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ab0 expref: 6 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432621.632972:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba417600, rc 0) 00000100:00100000:1.0:1787432621.633045:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+6:5605:x1874258791760128:12345-192.168.202.15@tcp:101: Request processed in 184us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432621.633069:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 114 00000100:00100000:2.0:1787432621.641895:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432621.642794:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791760384 00000100:00100000:3.0:1787432621.642812:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791760384 00000100:00100000:3.0:1787432621.642912:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 115 00000100:00100000:3.0:1787432621.642927:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+6:5605:x1874258791760384:12345-192.168.202.15@tcp:501: 00000100:00100000:3.0:1787432621.644076:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+6:5605:x1874258791760384:12345-192.168.202.15@tcp:501: Request processed in 1134us (2178us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787432621.644092:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 115 00000100:00100000:0.0:1787432621.656820:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432621.656973:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791760512 00000100:00100000:1.0:1787432621.656990:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791760512 00000100:00100000:1.0:1787432621.657076:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 116 00000100:00100000:1.0:1787432621.657092:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+6:5605:x1874258791760512:12345-192.168.202.15@tcp:101: 00010000:00010000:1.0:1787432621.657120:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432621.657156:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba416600/0xbcb9e331c3f0fa10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a025ab7 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432621.657208:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba416600/0xbcb9e331c3f0fa10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ab7 expref: 7 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432621.657221:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba416600/0xbcb9e331c3f0fa10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ab7 expref: 7 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432621.657232:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba416600, rc 0) 00000100:00100000:1.0:1787432621.657317:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+7:5605:x1874258791760512:12345-192.168.202.15@tcp:101: Request processed in 230us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432621.657325:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 116 00000100:00100000:0.0:1787432621.671625:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432621.672530:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791760640 00000100:00100000:1.0:1787432621.672548:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791760640 00000100:00100000:1.0:1787432621.672650:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 117 00000100:00100000:1.0:1787432621.672693:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+7:5605:x1874258791760640:12345-192.168.202.15@tcp:501: 00000100:00100000:1.0:1787432621.673965:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+8:5605:x1874258791760640:12345-192.168.202.15@tcp:501: Request processed in 1265us (2345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432621.673981:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 117 00000100:00100000:0.0:1787432621.678860:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432621.679036:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791760768 00000100:00100000:2.0:1787432621.679051:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791760768 00000100:00100000:2.0:1787432621.679145:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 118 00000100:00100000:2.0:1787432621.679157:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+8:5605:x1874258791760768:12345-192.168.202.15@tcp:503: 00000100:00100000:2.0:1787432621.681291:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+8:5605:x1874258791760768:12345-192.168.202.15@tcp:503: Request processed in 1673us (1983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432621.681314:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 118 00000100:00100000:0.0:1787432621.691794:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432621.692032:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791760896 00000100:00100000:3.0:1787432621.692047:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791760896 00000100:00100000:3.0:1787432621.692146:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 119 00000100:00100000:3.0:1787432621.692159:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+8:5623:x1874258791760896:12345-192.168.202.15@tcp:502: 00000100:00100000:3.0:1787432621.693996:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+8:5623:x1874258791760896:12345-192.168.202.15@tcp:502: Request processed in 1824us (2205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432621.694013:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 119 00000100:00100000:0.0:1787432621.732010:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432621.732500:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791761024 00000100:00100000:2.0:1787432621.732516:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791761024 00000100:00100000:2.0:1787432621.732761:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 120 00000100:00100000:2.0:1787432621.732795:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+8:5623:x1874258791761024:12345-192.168.202.15@tcp:502: 00000100:00100000:2.0:1787432621.733208:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+8:5623:x1874258791761024:12345-192.168.202.15@tcp:502: Request processed in 414us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432621.733217:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 120 00000100:00100000:0.0:1787432621.741456:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432621.751357:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791761152 00000100:00100000:1.0:1787432621.751420:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791761152 00000100:00100000:1.0:1787432621.751513:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 121 00000100:00100000:1.0:1787432621.751526:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+8:5605:x1874258791761152:12345-192.168.202.15@tcp:101: 00010000:00010000:1.0:1787432621.751549:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432621.751577:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba416a00/0xbcb9e331c3f0fa17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a025ae1 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432621.752178:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba416a00/0xbcb9e331c3f0fa17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ae1 expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432621.752261:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba416a00/0xbcb9e331c3f0fa17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ae1 expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432621.752273:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba416a00, rc 0) 00000100:00100000:1.0:1787432621.752406:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+9:5605:x1874258791761152:12345-192.168.202.15@tcp:101: Request processed in 882us (10961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432621.752415:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 121 00000100:00100000:0.0:1787432621.769243:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432621.769391:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791761280 00000100:00100000:1.0:1787432621.769413:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791761280 00000100:00100000:1.0:1787432621.769735:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 122 00000100:00100000:1.0:1787432621.769749:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+9:5605:x1874258791761280:12345-192.168.202.15@tcp:256: 20000000:01000000:1.0:1787432621.769786:0:5861:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787432621.769822:0:5861:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787432621.769827:0:5861:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787432621.769831:0:5861:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787432621.769834:0:5861:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787432621.774963:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+9:5605:x1874258791761280:12345-192.168.202.15@tcp:256: Request processed in 5196us (5713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432621.774988:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 122 00000100:00100000:0.0:1787432621.783554:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432621.783653:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791761408 00000100:00100000:3.0:1787432621.783699:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791761408 00000100:00100000:3.0:1787432621.783778:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 123 00000100:00100000:3.0:1787432621.783790:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+9:5605:x1874258791761408:12345-192.168.202.15@tcp:101: 00010000:00010000:3.0:1787432621.783810:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432621.783831:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bc2154e00/0xbcb9e331c3f0fa1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a025ae8 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432621.783896:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bc2154e00/0xbcb9e331c3f0fa1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ae8 expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432621.783908:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bc2154e00/0xbcb9e331c3f0fa1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ae8 expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432621.783920:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154e00, rc 0) 00000100:00100000:3.0:1787432621.783984:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:5605:x1874258791761408:12345-192.168.202.15@tcp:101: Request processed in 197us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432621.783992:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 123 00000100:00100000:0.0:1787432621.792441:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432621.792563:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791761536 00000100:00100000:1.0:1787432621.792577:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791761536 00000100:00100000:1.0:1787432621.792645:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 124 00000100:00100000:1.0:1787432621.792698:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:5605:x1874258791761536:12345-192.168.202.15@tcp:501: 00000100:00100000:1.0:1787432621.793301:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:5605:x1874258791761536:12345-192.168.202.15@tcp:501: Request processed in 643us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432621.793310:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 124 00000100:00100000:0.0:1787432621.797556:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432621.800758:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791761664 00000100:00100000:2.0:1787432621.800774:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791761664 00000100:00100000:2.0:1787432621.800871:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 125 00000100:00100000:2.0:1787432621.800893:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:5605:x1874258791761664:12345-192.168.202.15@tcp:503: 00000100:00100000:2.0:1787432621.801641:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:5605:x1874258791761664:12345-192.168.202.15@tcp:503: Request processed in 755us (4090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432621.801652:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 125 00000100:00100000:0.0:1787432621.809265:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432621.810952:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791761792 00000100:00100000:1.0:1787432621.810971:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791761792 00000100:00100000:1.0:1787432621.811056:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 126 00000100:00100000:1.0:1787432621.811067:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:5627:x1874258791761792:12345-192.168.202.15@tcp:502: 00000100:00100000:1.0:1787432621.811395:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:5627:x1874258791761792:12345-192.168.202.15@tcp:502: Request processed in 328us (2139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432621.811403:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 126 00000100:00100000:0.0:1787432621.814217:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432621.814480:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791761920 00000100:00100000:2.0:1787432621.814492:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791761920 00000100:00100000:2.0:1787432621.814565:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 127 00000100:00100000:2.0:1787432621.814575:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:5627:x1874258791761920:12345-192.168.202.15@tcp:502: 00000100:00100000:2.0:1787432621.814877:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:5627:x1874258791761920:12345-192.168.202.15@tcp:502: Request processed in 302us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432621.815868:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 127 00000100:00100000:1.0:1787432621.817137:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812755968:0@lo:13: 00000100:00100000:1.0:1787432621.817213:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432621.817701:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812755968 00000100:00100000:0.0:1787432621.817709:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812755968 00000100:00100000:0.0:1787432621.817760:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787432621.817769:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812755968:12345-0@lo:13: 00002000:00000024:0.0:1787432621.817810:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787432621.817870:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812755968:12345-0@lo:13: Request processed in 102us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432621.817877:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787432621.818073:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bba0a8700 x1874258812755968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432621.818092:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812755968:0@lo:13: 00000100:00100000:3.0:1787432621.820085:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812756096:0@lo:13: 00000100:00100000:3.0:1787432621.820165:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432621.820228:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812756096 00000100:00100000:3.0:1787432621.820235:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812756096 00000100:00100000:3.0:1787432621.820280:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787432621.820289:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812756096:12345-0@lo:13: 00002000:00000024:2.0:1787432621.823009:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1787432621.823652:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935b86833b80 x1874258812756096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432621.823691:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812756096:0@lo:13: 00000100:00100000:2.0:1787432621.823776:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812756096:12345-0@lo:13: Request processed in 3010us (3133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432621.823788:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787432621.828642:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432621.828863:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791762048 00000100:00100000:3.0:1787432621.828874:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791762048 00000100:00100000:3.0:1787432621.828948:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:3.0:1787432621.828958:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2374:x1874258791762048:12345-192.168.202.15@tcp:38: 00010000:00080000:3.0:1787432621.828993:0:5869:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:3.0:1787432621.829049:0:5869:0:(genops.c:1385:class_connect()) connect: client ee8b542c-0113-490f-a721-62606ee0807f, cookie 0xbcb9e331c3f0fa25 00000004:00100000:3.0:1787432621.829098:0:5869:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787432621.829106:0:5869:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787432621.907588:0:5869:0:(import.c:65:import_set_state_nolock()) ffff935bbabe2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432621.907805:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+6:2374:x1874258791762048:12345-192.168.202.15@tcp:38: Request processed in 78844us (79174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432621.907832:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00010000:00010000:0.0:1787432622.198030:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432622.918703:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432622.918782:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791762176 00000100:00100000:3.0:1787432622.918793:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791762176 00000100:00100000:3.0:1787432622.918884:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:3.0:1787432622.918896:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:0:x1874258791762176:12345-192.168.202.15@tcp:41: 00000004:00000024:3.0:1787432622.918953:0:5868:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787432622.919048:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:0:x1874258791762176:12345-192.168.202.15@tcp:41: Request processed in 153us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432622.919056:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00080000:1.0:1787432622.919159:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432622.925975:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432622.927323:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791762304 00000100:00100000:2.0:1787432622.927339:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791762304 00000100:00100000:2.0:1787432622.927425:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:2.0:1787432622.927439:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:5605:x1874258791762304:12345-192.168.202.15@tcp:41: 00000004:00000024:2.0:1787432622.927491:0:6929:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787432622.927600:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:5605:x1874258791762304:12345-192.168.202.15@tcp:41: Request processed in 163us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432622.927609:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:2.0:1787432622.931958:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432622.932086:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791762432 00000100:00100000:0.0:1787432622.932108:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791762432 00000100:00100000:0.0:1787432622.932186:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:0.0:1787432622.932198:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+6:5605:x1874258791762432:12345-192.168.202.15@tcp:40: 00000100:00100000:0.0:1787432622.932324:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+6:5605:x1874258791762432:12345-192.168.202.15@tcp:40: Request processed in 128us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432622.932332:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:3.0:1787432622.935053:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432622.935262:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791762816 00000100:00100000:2.0:1787432622.935272:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791762816 00000100:00100000:2.0:1787432622.935331:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:2.0:1787432622.935342:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+6:5605:x1874258791762816:12345-192.168.202.15@tcp:33: 00000100:00100000:3.0:1787432622.939428:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432622.939476:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432622.939530:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432622.939618:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791762560 00000100:00100000:0.0:1787432622.939631:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791762560 00000100:00100000:0.0:1787432622.939703:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791762688 00000100:00100000:0.0:1787432622.939706:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791762688 00000100:00100000:0.0:1787432622.939722:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:0.0:1787432622.939732:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2374:x1874258791762560:12345-192.168.202.15@tcp:8: 00010000:00080000:0.0:1787432622.939777:0:6725:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:0.0:1787432622.939818:0:6725:0:(genops.c:1385:class_connect()) connect: client ee8b542c-0113-490f-a721-62606ee0807f, cookie 0xbcb9e331c3f0fa2c 00002000:00100000:0.0:1787432622.939833:0:6725:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ee8b542c-0113-490f-a721-62606ee0807f/ffff935bbabe0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787432622.939848:0:6725:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787432622.940273:0:6725:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787432622.940302:0:6725:0:(import.c:65:import_set_state_nolock()) ffff935bbabe7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432622.940374:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2374:x1874258791762560:12345-192.168.202.15@tcp:8: Request processed in 642us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432622.940382:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:0.0:1787432622.940408:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:0.0:1787432622.940412:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9929c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2374:x1874258791762688:12345-192.168.202.15@tcp:8: 00010000:00080000:0.0:1787432622.940427:0:6725:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:0.0:1787432622.940445:0:6725:0:(genops.c:1385:class_connect()) connect: client ee8b542c-0113-490f-a721-62606ee0807f, cookie 0xbcb9e331c3f0fa33 00002000:00100000:0.0:1787432622.940450:0:6725:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ee8b542c-0113-490f-a721-62606ee0807f/ffff935bbabe0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787432622.940456:0:6725:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787432622.940681:0:6725:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787432622.940697:0:6725:0:(import.c:65:import_set_state_nolock()) ffff935bbabe2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432622.940720:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9929c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2374:x1874258791762688:12345-192.168.202.15@tcp:8: Request processed in 306us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432622.940726:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:1.0:1787432622.941027:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791762944 00000100:00100000:1.0:1787432622.941033:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791762944 00000100:00100000:1.0:1787432622.941081:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 128 00000100:00100000:1.0:1787432622.941089:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2377:x1874258791762944:12345-192.168.202.15@tcp:400: 00000100:00100000:1.0:1787432622.941138:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2377:x1874258791762944:12345-192.168.202.15@tcp:400: Request processed in 49us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432622.941153:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 128 00000004:00080000:2.0:1787432622.977523:0:5870:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 42111us 00000004:00200000:1.0:1787432623.005349:0:5870:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787432623.005882:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+6:5605:x1874258791762816:12345-192.168.202.15@tcp:33: Request processed in 70531us (70828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432623.005900:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00010000:00010000:0.0:1787432623.222012:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432623.286458:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432623.286578:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791763072 00000100:00100000:3.0:1787432623.286596:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791763072 00000100:00100000:3.0:1787432623.286686:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:3.0:1787432623.286698:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+6:5644:x1874258791763072:12345-192.168.202.15@tcp:101: 00010000:00010000:3.0:1787432623.286722:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432623.286793:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f0fa3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025b12 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432623.286863:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fa41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432623.286878:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fa41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432623.286912:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fa41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432623.287133:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787432623.287139:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432623.287218:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fa41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432623.287248:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f0fa3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b12 expref: 8 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432623.287267:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fa41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b12 expref: 7 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432623.287275:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a100) 00010000:00010000:3.0:1787432623.287278:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432623.287281:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155600, rc 0) 00000100:00100000:3.0:1787432623.287361:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+7:5644:x1874258791763072:12345-192.168.202.15@tcp:101: Request processed in 664us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432623.287369:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00010000:00010000:0.0:1787432624.246254:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432625.269979:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432625.605590:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432625.605765:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791763200 00000100:00100000:0.0:1787432625.605781:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791763200 00000100:00100000:0.0:1787432625.605905:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:0.0:1787432625.605926:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+7:5696:x1874258791763200:12345-192.168.202.15@tcp:41: 00000100:00080000:1.0:1787432625.605968:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1787432625.606000:0:8110:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787432625.606398:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+7:5696:x1874258791763200:12345-192.168.202.15@tcp:41: Request processed in 479us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432625.606409:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:0.0:1787432625.612301:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432625.612757:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791763328 00000100:00100000:2.0:1787432625.612775:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791763328 00000100:00100000:2.0:1787432625.612955:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:2.0:1787432625.612969:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ee8b542c-0113-490f-a721-62606ee0807f+6:5696:x1874258791763328:12345-192.168.202.15@tcp:13: 00002000:00000024:2.0:1787432625.613036:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432625.613155:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ee8b542c-0113-490f-a721-62606ee0807f+6:5696:x1874258791763328:12345-192.168.202.15@tcp:13: Request processed in 189us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432625.613165:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:0.0:1787432625.616218:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432625.616599:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791763456 00000100:00100000:2.0:1787432625.616614:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791763456 00000100:00080000:1.0:1787432625.617049:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432625.617055:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787432625.617914:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:2.0:1787432625.617936:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ee8b542c-0113-490f-a721-62606ee0807f+6:5696:x1874258791763456:12345-192.168.202.15@tcp:13: 00002000:00000024:2.0:1787432625.617993:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432625.618126:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ee8b542c-0113-490f-a721-62606ee0807f+6:5696:x1874258791763456:12345-192.168.202.15@tcp:13: Request processed in 199us (1921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432625.618157:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000001:00100000:2.0:1787432625.986704:0:6749:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ee8b542c-0113-490f-a721-62606ee0807f 00010000:00010000:1.0:1787432626.293845:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432626.430879:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb992b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812756608:0@lo:400: 00000100:00100000:3.0:1787432626.430959:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432626.431164:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787432626.431172:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb992b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812756480:0@lo:400: 00000100:00100000:3.0:1787432626.431201:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432626.431238:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812756608 00000100:00100000:3.0:1787432626.431262:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812756608 00000100:00100000:1.0:1787432626.431382:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812756224:0@lo:400: 00000100:00100000:1.0:1787432626.431417:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432626.431450:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812756736:0@lo:400: 00000100:00100000:1.0:1787432626.431473:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432626.431495:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787432626.431501:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb992b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874258812756352:0@lo:400: 00000100:00100000:1.0:1787432626.431523:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432626.431541:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb992ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812756864:0@lo:400: 00000100:00100000:1.0:1787432626.431561:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432626.431592:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812756224 00000100:00100000:1.0:1787432626.431596:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812756224 00000100:00100000:1.0:1787432626.431639:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787432626.431649:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812756224:12345-0@lo:400: 00000100:00100000:1.0:1787432626.431733:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812756224:12345-0@lo:400: Request processed in 84us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432626.431741:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787432626.431777:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812756480 00000100:00100000:1.0:1787432626.431790:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812756480 00000100:00100000:1.0:1787432626.431824:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812756736 00000100:00100000:1.0:1787432626.431826:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812756736 00000100:00100000:1.0:1787432626.431858:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812756352 00000100:00100000:1.0:1787432626.431861:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812756352 00000100:00100000:1.0:1787432626.431877:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787432626.431884:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812756480:12345-0@lo:400: 00000100:00100000:1.0:1787432626.431922:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812756480:12345-0@lo:400: Request processed in 38us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432626.431929:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787432626.431942:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787432626.431949:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812756736:12345-0@lo:400: 00000100:00100000:1.0:1787432626.431976:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812756736:12345-0@lo:400: Request processed in 28us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432626.431981:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787432626.433720:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812756864 00000100:00100000:3.0:1787432626.433735:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812756864 00000100:00100000:3.0:1787432626.433769:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787432626.433779:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812756608:12345-0@lo:400: 00000100:00100000:3.0:1787432626.433874:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812756608:12345-0@lo:400: Request processed in 97us (2916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432626.433881:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787432626.433896:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432626.433902:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812756864:12345-0@lo:400: 00000100:00100000:3.0:1787432626.433935:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812756864:12345-0@lo:400: Request processed in 34us (2373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432626.433941:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432626.433972:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787432626.433981:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874258812756352:12345-0@lo:400: 00000100:00080000:1.0:1787432626.434145:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432626.434151:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787432626.434153:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787432626.434202:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb992ad80 x1874258812756864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432626.434218:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb992ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812756864:0@lo:400: 00000100:00100000:1.0:1787432626.434230:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812756224:0@lo:400: 00000100:00100000:1.0:1787432626.434244:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812756736:0@lo:400: 00000100:00100000:1.0:1787432626.434469:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb992b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812756480:0@lo:400: 00010000:00080000:1.0:1787432626.434499:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb992b100 x1874258812756608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432626.434531:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb992b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812756608:0@lo:400: 00000100:00100000:3.0:1787432626.435203:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874258812756352:12345-0@lo:400: Request processed in 1219us (3674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432626.435213:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787432626.435654:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb992b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874258812756352:0@lo:400: 00000001:00100000:2.0:1787432626.538031:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ee8b542c-0113-490f-a721-62606ee0807f 00000100:00100000:1.0:1787432626.937405:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812756992:0@lo:13: 00000100:00100000:1.0:1787432626.937517:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432626.937601:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432626.937609:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812757120:0@lo:13: 00000100:00100000:1.0:1787432626.937634:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432626.937700:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812756992 00000100:00100000:1.0:1787432626.937709:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812756992 00000100:00100000:1.0:1787432626.937755:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812757120 00000100:00100000:1.0:1787432626.937758:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812757120 00000100:00100000:1.0:1787432626.937776:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787432626.937785:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812756992:12345-0@lo:13: 00002000:00000024:1.0:1787432626.937814:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432626.937878:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812756992:12345-0@lo:13: Request processed in 79us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432626.937886:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787432626.937909:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787432626.937917:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812757120:12345-0@lo:13: 00002000:00000024:1.0:1787432626.937930:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432626.937959:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812757120:12345-0@lo:13: Request processed in 43us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432626.937966:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787432626.938988:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935a84b45880 x1874258812757120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432626.939024:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812757120:0@lo:13: 00010000:00080000:1.0:1787432626.939061:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935a84b44000 x1874258812756992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432626.939075:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812756992:0@lo:13: 00000001:00100000:1.0:1787432627.015805:0:5889:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ee8b542c-0113-490f-a721-62606ee0807f 00010000:00010000:0.0:1787432627.318088:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432628.145156:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432628.145203:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432628.145244:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432628.145277:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432628.145313:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791763712 00000100:00100000:0.0:1787432628.145327:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791763712 00000100:00100000:0.0:1787432628.145423:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:0.0:1787432628.145436:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+6:2378:x1874258791763712:12345-192.168.202.15@tcp:400: 00000100:00100000:0.0:1787432628.145539:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+6:2378:x1874258791763712:12345-192.168.202.15@tcp:400: Request processed in 105us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432628.145548:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:0.0:1787432628.145577:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791763840 00000100:00100000:0.0:1787432628.145582:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791763840 00000100:00100000:0.0:1787432628.145616:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791763968 00000100:00100000:0.0:1787432628.145619:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791763968 00000100:00100000:0.0:1787432628.145638:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:0.0:1787432628.145645:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8b542c-0113-490f-a721-62606ee0807f+5:2378:x1874258791763840:12345-192.168.202.15@tcp:400: 00000100:00100000:0.0:1787432628.145701:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8b542c-0113-490f-a721-62606ee0807f+5:2378:x1874258791763840:12345-192.168.202.15@tcp:400: Request processed in 57us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432628.145708:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:0.0:1787432628.145720:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:0.0:1787432628.145727:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9554e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8b542c-0113-490f-a721-62606ee0807f+5:2378:x1874258791763968:12345-192.168.202.15@tcp:400: 00000100:00100000:0.0:1787432628.145752:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9554e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8b542c-0113-490f-a721-62606ee0807f+5:2378:x1874258791763968:12345-192.168.202.15@tcp:400: Request processed in 26us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432628.145757:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00080000:0.0:1787432628.145791:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787432628.145795:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787432628.145798:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432628.146553:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791763584 00000100:00100000:2.0:1787432628.146561:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791763584 00000100:00100000:2.0:1787432628.146612:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 130 00000100:00100000:2.0:1787432628.146622:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2378:x1874258791763584:12345-192.168.202.15@tcp:400: 00000100:00100000:2.0:1787432628.146698:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2378:x1874258791763584:12345-192.168.202.15@tcp:400: Request processed in 78us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432628.146706:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 130 00010000:00010000:2.0:1787432628.342081:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787432628.581576:0:8335:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787432629.366136:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432630.401133:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432631.418291:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432631.545176:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3331:1874258812757376:0@lo:400: 00000100:00100000:3.0:1787432631.545526:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812757248:0@lo:400: 00000100:00100000:3.0:1787432631.545637:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432631.545773:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812757760:0@lo:400: 00000100:00100000:3.0:1787432631.545811:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432631.545890:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812757248 00000100:00100000:3.0:1787432631.545903:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812757248 00000100:00100000:3.0:1787432631.545996:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787432631.546025:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812757248:12345-0@lo:400: 00000100:00100000:3.0:1787432631.546110:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812757248:12345-0@lo:400: Request processed in 88us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432631.546119:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787432631.546162:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812757760 00000100:00100000:3.0:1787432631.546167:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812757760 00000100:00100000:3.0:1787432631.546230:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787432631.546238:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb992aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812757760:12345-0@lo:400: 00000100:00100000:3.0:1787432631.546278:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb992aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812757760:12345-0@lo:400: Request processed in 42us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432631.546284:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787432631.546325:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812757248:0@lo:400: 00000100:00100000:3.0:1787432631.546341:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812757760:0@lo:400: 00000100:00080000:3.0:1787432631.546394:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432631.547148:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432631.547182:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812757888:0@lo:400: 00000100:00100000:0.0:1787432631.547215:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432631.548868:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812757632:0@lo:400: 00000100:00100000:0.0:1787432631.548943:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432631.548981:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787432631.548990:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812757504:0@lo:400: 00000100:00100000:0.0:1787432631.549016:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432631.549065:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812757888 00000100:00100000:0.0:1787432631.549075:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812757888 00000100:00100000:0.0:1787432631.549156:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812757632 00000100:00100000:0.0:1787432631.549159:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812757632 00000100:00100000:0.0:1787432631.549180:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787432631.549194:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812757888:12345-0@lo:400: 00000100:00100000:3.0:1787432631.550633:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812757376 00000100:00100000:3.0:1787432631.550648:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812757376 00000100:00100000:3.0:1787432631.550750:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812757504 00000100:00100000:3.0:1787432631.550755:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812757504 00000100:00100000:3.0:1787432631.550807:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787432631.550818:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3331:x1874258812757376:12345-0@lo:400: 00000100:00100000:3.0:1787432631.550928:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3331:x1874258812757376:12345-0@lo:400: Request processed in 112us (3781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432631.550936:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787432631.550955:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787432631.550962:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812757504:12345-0@lo:400: 00000100:00100000:3.0:1787432631.551000:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812757504:12345-0@lo:400: Request processed in 38us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432631.551025:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787432631.551063:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432631.551068:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787432631.551070:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432631.551131:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812757504:0@lo:400: 00000100:00100000:3.0:1787432631.551174:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3331:1874258812757376:0@lo:400: 00000100:00100000:2.0:1787432631.552427:0:6726:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787432631.552450:0:6726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787432631.552489:0:6725:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787432631.552516:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432631.552536:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812757632:12345-0@lo:400: 00000100:00100000:2.0:1787432631.552647:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812757632:12345-0@lo:400: Request processed in 119us (3704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432631.552691:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787432631.553516:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812757888:12345-0@lo:400: Request processed in 4311us (6284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432631.553528:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787432631.554134:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb9557100 x1874258812757632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432631.554155:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812757632:0@lo:400: 00010000:00080000:2.0:1787432631.554434:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa60700 x1874258812757888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432631.554446:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812757888:0@lo:400: 00000100:00100000:2.0:1787432632.054818:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812758016:0@lo:13: 00000100:00100000:2.0:1787432632.054935:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432632.055511:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812758016 00000100:00100000:1.0:1787432632.055523:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812758016 00000100:00100000:1.0:1787432632.055588:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787432632.055600:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812758016:12345-0@lo:13: 00002000:00000024:1.0:1787432632.055647:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787432632.056362:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb992a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812758144:0@lo:13: 00000100:00100000:3.0:1787432632.056425:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432632.056727:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812758016:12345-0@lo:13: Request processed in 1126us (1789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432632.056739:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787432632.056766:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812758144 00000100:00100000:1.0:1787432632.056774:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812758144 00000100:00100000:1.0:1787432632.056804:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787432632.056812:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812758144:12345-0@lo:13: 00002000:00000024:1.0:1787432632.056845:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432632.056890:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812758144:12345-0@lo:13: Request processed in 79us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432632.056897:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787432632.057282:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb992a300 x1874258812758144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432632.057306:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb992a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812758144:0@lo:13: 00010000:00080000:2.0:1787432632.060693:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa63b80 x1874258812758016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432632.060750:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812758016:0@lo:13: 00010000:00010000:3.0:1787432632.437939:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787432632.456853:0:8484:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeda77b4b0 20000000:00000080:0.0:1787432632.456882:0:8484:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff935b90702c00 uarg=0000000000000000 20000000:01000000:0.0:1787432632.457151:0:8484:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787432632.457155:0:8484:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787432632.457158:0:8484:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787432632.457164:0:8484:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787432632.457180:0:8484:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787432632.457204:0:8484:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787432632.457206:0:8484:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787432632.457591:0:8484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787432632.457595:0:8484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787432632.459324:0:8485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787432632.460281:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787432632.460364:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1787432632.460420:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1787432632.460436:0:8484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787432632.460440:0:8484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787432632.461560:0:8486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1787432632.462580:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1787432632.462638:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1787432632.462768:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1787432632.462800:0:8484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787432632.462804:0:8484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787432632.465492:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1787432632.466218:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1787432632.466286:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787432632.466325:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1787432632.466344:0:8484:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787432632.466347:0:8484:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787432632.468185:0:8488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1787432632.469242:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1787432632.469334:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1787432632.469373:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1787432632.469473:0:8484:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787432632.469502:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0fa48 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.469526:0:8484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bb5210400/0xbcb9e331c3f0f945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f93e expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.469534:0:8484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0f96f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f968 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.469541:0:8484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bc2167200/0xbcb9e331c3f0f999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f992 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.469548:0:8484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0f9a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f9a0 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.469569:0:8484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bc2154800/0xbcb9e331c3f0f9b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f9ae expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.469576:0:8484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bc2167400/0xbcb9e331c3f0f9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f9ca expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.469583:0:8484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935b80030000/0xbcb9e331c3f0f9fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f9f4 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.469595:0:8484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bba417600/0xbcb9e331c3f0fa09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ab0 expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.469603:0:8484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bba416600/0xbcb9e331c3f0fa10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ab7 expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.469612:0:8484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0fa48 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.469864:0:8484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bba416600/0xbcb9e331c3f0fa10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ab7 expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.469887:0:8484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff935bba416600/0xbcb9e331c3f0fa10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ab7 expref: 9 pid: 5862 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432632.469993:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa61c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874258812758272:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787432632.470294:0:8484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bba417600/0xbcb9e331c3f0fa09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ab0 expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.470305:0:8484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff935bba417600/0xbcb9e331c3f0fa09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ab0 expref: 9 pid: 5861 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432632.470328:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa60380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874258812758400:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787432632.470368:0:8484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935b80030000/0xbcb9e331c3f0f9fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f9f4 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.470391:0:8484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935b80030000/0xbcb9e331c3f0f9fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f9f4 expref: 18 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432632.470404:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa61180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874258812758528:0@lo:104: 00000100:00100000:0.0:1787432632.470458:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787432632.470505:0:8484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bc2167400/0xbcb9e331c3f0f9d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f9ca expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.470513:0:8484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bc2167400/0xbcb9e331c3f0f9d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f9ca expref: 18 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432632.470522:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa63800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874258812758656:0@lo:104: 00000100:00100000:0.0:1787432632.470548:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787432632.470583:0:8484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bc2154800/0xbcb9e331c3f0f9b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f9ae expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.470591:0:8484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bc2154800/0xbcb9e331c3f0f9b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f9ae expref: 18 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432632.470599:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa63100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874258812758784:0@lo:104: 00010000:00010000:0.0:1787432632.470620:0:8484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0f9a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f9a0 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.470627:0:8484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0f9a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f9a0 expref: 18 pid: 5862 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432632.470644:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa60000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874258812758912:0@lo:104: 00010000:00010000:0.0:1787432632.470707:0:8484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bc2167200/0xbcb9e331c3f0f999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f992 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.470716:0:8484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bc2167200/0xbcb9e331c3f0f999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f992 expref: 18 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432632.470725:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa62d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874258812759040:0@lo:104: 00010000:00010000:0.0:1787432632.470755:0:8484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0f96f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f968 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.470764:0:8484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0f96f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f968 expref: 18 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432632.470772:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa61880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874258812759168:0@lo:104: 00010000:00010000:0.0:1787432632.470798:0:8484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bb5210400/0xbcb9e331c3f0f945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f93e expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432632.470806:0:8484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bb5210400/0xbcb9e331c3f0f945 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f93e expref: 18 pid: 5860 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432632.470815:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa60a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874258812759296:0@lo:104: 00000100:00100000:0.0:1787432632.470833:0:8484:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba2ac46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432632.470964:0:5850:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787432632.470986:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432632.471000:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432632.471020:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432632.471039:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432632.471048:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432632.471057:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812758528 00000100:00100000:2.0:1787432632.471064:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812758528 00000100:00100000:2.0:1787432632.471116:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812758656 00000100:00100000:2.0:1787432632.471119:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812758656 00000100:00100000:2.0:1787432632.471132:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812758784 00000100:00100000:2.0:1787432632.471134:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812758784 00000100:00100000:2.0:1787432632.471143:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812758912 00000100:00100000:2.0:1787432632.471145:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812758912 00000100:00100000:2.0:1787432632.471156:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812759040 00000100:00100000:2.0:1787432632.471159:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812759040 00000100:00100000:2.0:1787432632.471167:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812759168 00000100:00100000:2.0:1787432632.471169:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812759168 00000100:00100000:2.0:1787432632.471177:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812759296 00000100:00100000:2.0:1787432632.471179:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812759296 00000100:00100000:2.0:1787432632.471193:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787432632.471203:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+9:8484:x1874258812758528:12345-0@lo:104: 00010000:00010000:2.0:1787432632.471220:0:5850:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bba417400/0xbcb9e331c3f0f9f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f9fb expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.471290:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787432632.471297:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+9:8484:x1874258812758528:12345-0@lo:104: Request processed in 96us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432632.471304:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787432632.471336:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787432632.471344:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84a58450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+8:8484:x1874258812758656:12345-0@lo:104: 00010000:00010000:2.0:1787432632.471353:0:5850:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bc2167a00/0xbcb9e331c3f0f9ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f9d1 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.471394:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787432632.471399:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84a58450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+8:8484:x1874258812758656:12345-0@lo:104: Request processed in 57us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432632.471406:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787432632.471442:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787432632.471448:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9526680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+7:8484:x1874258812758784:12345-0@lo:104: 00010000:00010000:2.0:1787432632.471457:0:5850:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f9b5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.471484:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787432632.471489:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9526680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+7:8484:x1874258812758784:12345-0@lo:104: Request processed in 42us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432632.471496:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787432632.471509:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787432632.471514:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9527b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+6:8484:x1874258812758912:12345-0@lo:104: 00010000:00010000:2.0:1787432632.471522:0:5850:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bb5210600/0xbcb9e331c3f0f9a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f9a7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.471549:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787432632.471555:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9527b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+6:8484:x1874258812758912:12345-0@lo:104: Request processed in 41us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432632.471561:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787432632.471582:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787432632.471588:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9524380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+5:8484:x1874258812759040:12345-0@lo:104: 00010000:00010000:2.0:1787432632.471596:0:5850:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bc2155c00/0xbcb9e331c3f0f992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f999 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.471627:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787432632.471632:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9524380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+5:8484:x1874258812759040:12345-0@lo:104: Request processed in 45us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432632.471638:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787432632.471650:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787432632.471702:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9526300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+4:8484:x1874258812759168:12345-0@lo:104: 00010000:00010000:2.0:1787432632.471711:0:5850:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0f968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f96f expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.471741:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1787432632.471747:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9526300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+4:8484:x1874258812759168:12345-0@lo:104: Request processed in 91us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432632.471753:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787432632.471767:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787432632.471774:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+3:8484:x1874258812759296:12345-0@lo:104: 00010000:00010000:2.0:1787432632.471782:0:5850:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f93e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f945 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.471809:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1787432632.471814:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+3:8484:x1874258812759296:12345-0@lo:104: Request processed in 41us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432632.471819:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787432632.472244:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787432632.472254:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bba417400/0xbcb9e331c3f0f9f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f9fb expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472263:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba417400 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:1.0:1787432632.472269:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bba417400/0xbcb9e331c3f0f9f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f9fb expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472291:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bba417400/0xbcb9e331c3f0f9f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f9fb expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432632.472300:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bba417400/0xbcb9e331c3f0f9f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f9fb expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432632.472308:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432632.472363:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bba417400/0xbcb9e331c3f0f9f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f9fb expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472385:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432632.472419:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bba417400/0xbcb9e331c3f0f9f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f9fb expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472428:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bba417400/0xbcb9e331c3f0f9f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f9fb expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472447:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787432632.472451:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bc2167a00/0xbcb9e331c3f0f9ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f9d1 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472456:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2167a00 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:1.0:1787432632.472460:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bc2167a00/0xbcb9e331c3f0f9ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f9d1 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472467:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bc2167a00/0xbcb9e331c3f0f9ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f9d1 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432632.472474:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bc2167a00/0xbcb9e331c3f0f9ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f9d1 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432632.472487:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432632.472504:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bc2167a00/0xbcb9e331c3f0f9ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f9d1 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472511:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432632.472517:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bc2167a00/0xbcb9e331c3f0f9ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f9d1 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472524:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bc2167a00/0xbcb9e331c3f0f9ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f9d1 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472536:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787432632.472540:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f9b5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472546:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031a00 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:1.0:1787432632.472549:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f9b5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472556:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f9ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f9b5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432632.472562:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f9ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f9b5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432632.472568:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432632.472584:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f9ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f9b5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472591:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432632.472617:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f9ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f9b5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472625:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0f9ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f9b5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472637:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787432632.472640:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bb5210600/0xbcb9e331c3f0f9a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f9a7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472647:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bb5210600 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:1.0:1787432632.472650:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bb5210600/0xbcb9e331c3f0f9a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f9a7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472678:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bb5210600/0xbcb9e331c3f0f9a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f9a7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432632.472685:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bb5210600/0xbcb9e331c3f0f9a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f9a7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432632.472690:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432632.472706:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bb5210600/0xbcb9e331c3f0f9a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f9a7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472713:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432632.472719:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bb5210600/0xbcb9e331c3f0f9a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f9a7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472726:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bb5210600/0xbcb9e331c3f0f9a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f9a7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472736:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787432632.472746:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bc2155c00/0xbcb9e331c3f0f992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f999 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472752:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155c00 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:1.0:1787432632.472755:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bc2155c00/0xbcb9e331c3f0f992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f999 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472763:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bc2155c00/0xbcb9e331c3f0f992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f999 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432632.472769:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bc2155c00/0xbcb9e331c3f0f992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f999 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432632.472774:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432632.472806:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bc2155c00/0xbcb9e331c3f0f992 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f999 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472812:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432632.472817:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bc2155c00/0xbcb9e331c3f0f992 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f999 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472823:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bc2155c00/0xbcb9e331c3f0f992 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f999 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472833:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432632.472836:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0f968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f96f expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472841:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030c00 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:1.0:1787432632.472844:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0f968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f96f expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472859:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0f968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f96f expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432632.472866:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0f968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f96f expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432632.472872:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432632.472887:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0f968 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f96f expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472906:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432632.472912:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0f968 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f96f expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472920:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0f968 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f96f expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472931:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432632.472934:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f93e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f945 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472940:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2166800 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:1.0:1787432632.472943:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f93e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f945 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472950:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f93e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f945 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432632.472956:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f93e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f945 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432632.472968:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432632.472983:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f93e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f945 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.472989:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432632.472993:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f93e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f945 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.473000:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bc2166800/0xbcb9e331c3f0f93e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f945 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.473016:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432632.473035:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432632.473039:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432632.473071:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812759552:0@lo:103: 00000100:00100000:1.0:1787432632.473137:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432632.473186:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812760064:0@lo:103: 00000100:00100000:1.0:1787432632.473207:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432632.473240:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787432632.473246:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812759424:0@lo:103: 00000100:00100000:1.0:1787432632.473267:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432632.473284:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812759936:0@lo:103: 00000100:00100000:1.0:1787432632.473306:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432632.473328:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812759680:0@lo:103: 00000100:00100000:1.0:1787432632.473354:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432632.473364:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812760192:0@lo:103: 00000100:00100000:1.0:1787432632.473412:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432632.473427:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432632.473433:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812759808:0@lo:103: 00000100:00100000:1.0:1787432632.473461:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432632.473487:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812759552 00000100:00100000:1.0:1787432632.473495:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812759552 00010000:00010000:1.0:1787432632.473530:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bc2167400/0xbcb9e331c3f0f9d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f9ca expref: 19 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432632.473552:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812760064 00000100:00100000:1.0:1787432632.473555:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812760064 00010000:00010000:1.0:1787432632.473569:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0f96f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f968 expref: 20 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432632.473581:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812759424 00000100:00100000:1.0:1787432632.473584:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812759424 00010000:00010000:1.0:1787432632.473597:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935b80030000/0xbcb9e331c3f0f9fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f9f4 expref: 21 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432632.473608:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812759936 00000100:00100000:1.0:1787432632.473611:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812759936 00010000:00010000:1.0:1787432632.473623:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bc2167200/0xbcb9e331c3f0f999 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f992 expref: 22 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432632.473634:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812759680 00000100:00100000:1.0:1787432632.473637:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812759680 00010000:00010000:1.0:1787432632.473649:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bc2154800/0xbcb9e331c3f0f9b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f9ae expref: 23 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432632.473695:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812760192 00000100:00100000:1.0:1787432632.473699:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812760192 00010000:00010000:1.0:1787432632.473713:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bb5210400/0xbcb9e331c3f0f945 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f93e expref: 24 pid: 5860 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432632.473733:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812759808 00000100:00100000:1.0:1787432632.473736:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812759808 00010000:00010000:1.0:1787432632.473750:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0f9a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f9a0 expref: 25 pid: 5862 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432632.473767:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787432632.473777:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+25:3331:x1874258812759552:12345-0@lo:103: 00010000:00010000:1.0:1787432632.473793:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432632.473800:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bc2167400/0xbcb9e331c3f0f9d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f9ca expref: 25 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.473812:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bc2167400/0xbcb9e331c3f0f9d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f9ca expref: 25 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.473835:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432632.473876:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+25:3331:x1874258812759552:12345-0@lo:103: Request processed in 100us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432632.473884:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787432632.473907:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787432632.473913:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+24:3331:x1874258812760064:12345-0@lo:103: 00010000:00010000:1.0:1787432632.473921:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432632.473926:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0f96f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f968 expref: 24 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.473935:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0f96f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f968 expref: 24 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.473944:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432632.473974:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+24:3331:x1874258812760064:12345-0@lo:103: Request processed in 62us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432632.473981:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787432632.473994:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787432632.474000:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+23:3331:x1874258812759424:12345-0@lo:103: 00010000:00010000:1.0:1787432632.474008:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432632.474012:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935b80030000/0xbcb9e331c3f0f9fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f9f4 expref: 23 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.474021:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935b80030000/0xbcb9e331c3f0f9fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f9f4 expref: 23 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.474043:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432632.474068:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+23:3331:x1874258812759424:12345-0@lo:103: Request processed in 67us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432632.474074:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787432632.474086:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787432632.474093:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+22:3331:x1874258812759936:12345-0@lo:103: 00010000:00010000:1.0:1787432632.474101:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432632.474105:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bc2167200/0xbcb9e331c3f0f999 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f992 expref: 22 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.474114:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bc2167200/0xbcb9e331c3f0f999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f992 expref: 22 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.474124:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432632.474146:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+22:3331:x1874258812759936:12345-0@lo:103: Request processed in 54us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432632.474152:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787432632.474171:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787432632.474176:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+21:3332:x1874258812759680:12345-0@lo:103: 00010000:00010000:1.0:1787432632.474185:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432632.474190:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bc2154800/0xbcb9e331c3f0f9b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f9ae expref: 21 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.474198:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bc2154800/0xbcb9e331c3f0f9b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f9ae expref: 21 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.474206:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432632.474233:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+21:3332:x1874258812759680:12345-0@lo:103: Request processed in 56us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432632.474239:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787432632.474250:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787432632.474257:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+20:3332:x1874258812760192:12345-0@lo:103: 00010000:00010000:1.0:1787432632.474265:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432632.474269:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bb5210400/0xbcb9e331c3f0f945 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f93e expref: 20 pid: 5860 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.474277:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bb5210400/0xbcb9e331c3f0f945 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f93e expref: 20 pid: 5860 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.474286:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432632.474307:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+20:3332:x1874258812760192:12345-0@lo:103: Request processed in 51us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432632.474314:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787432632.474325:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787432632.474331:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935ba07d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812759808:12345-0@lo:103: 00010000:00010000:1.0:1787432632.474340:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432632.474351:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0f9a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f9a0 expref: 19 pid: 5862 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.474359:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0f9a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f9a0 expref: 19 pid: 5862 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.474369:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432632.474394:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935ba07d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812759808:12345-0@lo:103: Request processed in 63us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432632.474401:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787432632.474478:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812759808:0@lo:103: 00000100:00100000:1.0:1787432632.474493:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812759680:0@lo:103: 00000100:00100000:1.0:1787432632.474501:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812760192:0@lo:103: 00000100:00100000:1.0:1787432632.474534:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812759424:0@lo:103: 00000100:00100000:1.0:1787432632.474542:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812759936:0@lo:103: 00000100:00100000:1.0:1787432632.474549:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812759552:0@lo:103: 00000100:00100000:1.0:1787432632.474555:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812760064:0@lo:103: 00010000:00010000:0.0:1787432632.474742:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935b80030000/0xbcb9e331c3f0f9fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f9f4 expref: 18 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432632.474759:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa61180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874258812758528:0@lo:104: 00010000:00010000:0.0:1787432632.474775:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bc2167400/0xbcb9e331c3f0f9d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f9ca expref: 17 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432632.474793:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa63800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874258812758656:0@lo:104: 00010000:00010000:0.0:1787432632.474808:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bc2154800/0xbcb9e331c3f0f9b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f9ae expref: 16 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432632.474817:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa63100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874258812758784:0@lo:104: 00010000:00010000:0.0:1787432632.474829:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0f9a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f9a0 expref: 15 pid: 5862 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432632.474837:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa60000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874258812758912:0@lo:104: 00010000:00010000:0.0:1787432632.474846:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bc2167200/0xbcb9e331c3f0f999 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f992 expref: 14 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432632.474854:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa62d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874258812759040:0@lo:104: 00010000:00010000:0.0:1787432632.474864:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0f96f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f968 expref: 13 pid: 5861 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432632.474873:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa61880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874258812759168:0@lo:104: 00010000:00010000:0.0:1787432632.474884:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bb5210400/0xbcb9e331c3f0f945 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f93e expref: 12 pid: 5860 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432632.474892:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa60a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874258812759296:0@lo:104: 00010000:00010000:3.0:1787432632.475367:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432632.483625:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432632.483787:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432632.483892:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791764096 00000100:00100000:1.0:1787432632.483916:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791764096 00010000:00010000:1.0:1787432632.483972:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bba416600/0xbcb9e331c3f0fa10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ab7 expref: 10 pid: 5862 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432632.484040:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791764224 00000100:00100000:1.0:1787432632.484044:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791764224 00010000:00010000:1.0:1787432632.484058:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bba417600/0xbcb9e331c3f0fa09 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ab0 expref: 11 pid: 5861 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432632.484098:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:1.0:1787432632.484115:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+11:2376:x1874258791764096:12345-192.168.202.15@tcp:103: 00010000:00010000:1.0:1787432632.484136:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432632.484144:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bba416600/0xbcb9e331c3f0fa10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ab7 expref: 11 pid: 5862 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.484159:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bba416600/0xbcb9e331c3f0fa10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ab7 expref: 11 pid: 5862 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432632.484189:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432632.484263:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+11:2376:x1874258791764096:12345-192.168.202.15@tcp:103: Request processed in 150us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432632.484681:0:5851:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787432632.484694:0:5851:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1787432632.485273:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bba416600/0xbcb9e331c3f0fa10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ab7 expref: 11 pid: 5862 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432632.485315:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa61c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874258812758272:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787432632.485334:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa60380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874258812758400:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787432632.485386:0:8484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0fa48 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432632.487424:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:2.0:1787432632.487461:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2376:x1874258791764224:12345-192.168.202.15@tcp:103: 00010000:00010000:2.0:1787432632.487487:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432632.487499:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bba417600/0xbcb9e331c3f0fa09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ab0 expref: 10 pid: 5861 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.487520:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bba417600/0xbcb9e331c3f0fa09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ab0 expref: 10 pid: 5861 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432632.487529:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00010000:00010000:2.0:1787432632.487543:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bba417600/0xbcb9e331c3f0fa09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ab0 expref: 10 pid: 5861 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.487562:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0fa48 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.487570:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0fa48 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.487591:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0fa48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.487598:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0fa48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.487604:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0fa48 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.487611:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0fa48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.487618:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030400 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432632.487637:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0fa48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.487646:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0fa48 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.487679:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0fa48 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432632.487691:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432632.487760:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+8:2376:x1874258791764224:12345-192.168.202.15@tcp:103: Request processed in 319us (3972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432632.487767:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00010000:00010000:3.0:1787432632.489606:0:8484:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0fa48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.489628:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0fa48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432632.489636:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0fa48 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432633.268959:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432633.269041:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432633.269087:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432633.269118:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432633.269704:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791764352 00000100:00100000:2.0:1787432633.269718:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791764352 00000100:00100000:2.0:1787432633.269796:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 132 00000100:00100000:2.0:1787432633.269818:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+8:2376:x1874258791764352:12345-192.168.202.15@tcp:400: 00000100:00100000:2.0:1787432633.269950:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+8:2376:x1874258791764352:12345-192.168.202.15@tcp:400: Request processed in 143us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432633.269960:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 132 00000100:00100000:2.0:1787432633.270003:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791764736 00000100:00100000:2.0:1787432633.270008:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791764736 00000100:00100000:2.0:1787432633.270062:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791764608 00000100:00100000:2.0:1787432633.270066:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791764608 00000100:00100000:1.0:1787432633.270603:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791764480 00000100:00100000:1.0:1787432633.270610:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791764480 00000100:00100000:1.0:1787432633.270680:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:1.0:1787432633.270691:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb992a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791764480:12345-192.168.202.15@tcp:400: 00000100:00100000:1.0:1787432633.270750:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb992a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791764480:12345-192.168.202.15@tcp:400: Request processed in 63us (1811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432633.270757:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:1.0:1787432633.270837:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:1.0:1787432633.270846:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791764736:12345-192.168.202.15@tcp:400: 00000100:00100000:1.0:1787432633.270879:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791764736:12345-192.168.202.15@tcp:400: Request processed in 34us (1791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432633.270886:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:1.0:1787432633.270920:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:1.0:1787432633.270927:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+5:2376:x1874258791764608:12345-192.168.202.15@tcp:400: 00000100:00100000:1.0:1787432633.270953:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+5:2376:x1874258791764608:12345-192.168.202.15@tcp:400: Request processed in 27us (1836us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432633.270959:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00080000:3.0:1787432633.271276:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432633.271283:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787432633.271286:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787432633.463154:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787432634.101792:0:5864:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787432634.101804:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff935bbb06d800 from 39 10000000:01000000:1.0:1787432634.101813:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787432634.101884:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba416800/0xbcb9e331c3f0fa4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.101899:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bba416800/0xbcb9e331c3f0fa4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.101913:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bba416800/0xbcb9e331c3f0fa4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432634.101947:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812760320:0@lo:101: 00000100:00100000:1.0:1787432634.102077:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432634.102291:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432634.104148:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812760320 00000100:00100000:2.0:1787432634.104170:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812760320 00000100:00100000:2.0:1787432634.104256:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787432634.104268:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+12:5864:x1874258812760320:12345-0@lo:101: 00010000:00010000:2.0:1787432634.104290:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432634.104336:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0fa56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0fa4f expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.104374:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0fa56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fa4f expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.104388:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0fa56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fa4f expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.104399:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bb5210200, rc 0) 00000100:00100000:2.0:1787432634.104518:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:5864:x1874258812760320:12345-0@lo:101: Request processed in 253us (2441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432634.104526:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787432634.107396:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812760320:0@lo:101: 00010000:00010000:1.0:1787432634.107443:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bba416800/0xbcb9e331c3f0fa4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa56 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.107461:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bba416800/0xbcb9e331c3f0fa4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fa56 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432634.107578:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812760448:0@lo:501: 00000100:00100000:1.0:1787432634.107719:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432634.107847:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812760448 00000100:00100000:3.0:1787432634.107856:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812760448 00000100:00100000:3.0:1787432634.108988:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787432634.109028:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:5864:x1874258812760448:12345-0@lo:501: 00000100:00100000:3.0:1787432634.109523:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:5864:x1874258812760448:12345-0@lo:501: Request processed in 518us (1802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432634.113366:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432634.113437:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812760448:0@lo:501: 00000100:00100000:1.0:1787432634.113534:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812760576:0@lo:503: 00000100:00100000:1.0:1787432634.113682:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432634.113711:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432634.114247:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812760576 00000100:00100000:2.0:1787432634.114261:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812760576 00000100:00100000:2.0:1787432634.114320:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787432634.114335:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:5864:x1874258812760576:12345-0@lo:503: 00000100:00100000:2.0:1787432634.119269:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:5864:x1874258812760576:12345-0@lo:503: Request processed in 4924us (5574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432634.119294:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787432634.119850:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787432634.122286:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812760576:0@lo:503: 00000100:00100000:3.0:1787432634.130478:0:8502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb992a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8502:1874258812760704:0@lo:502: 00000100:00100000:3.0:1787432634.130633:0:8502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432634.130732:0:8502:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179c840 going to sleep for 11 seconds 00000100:00100000:2.0:1787432634.130764:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812760704 00000100:00100000:2.0:1787432634.130776:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812760704 00000100:00100000:2.0:1787432634.130847:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787432634.130859:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:8502:x1874258812760704:12345-0@lo:502: 00000100:00100000:2.0:1787432634.131566:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:8502:x1874258812760704:12345-0@lo:502: Request processed in 702us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432634.131578:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787432634.131829:0:8502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb992a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8502:1874258812760704:0@lo:502: 00000100:00100000:3.0:1787432634.131902:0:8502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb992a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8502:1874258812760832:0@lo:502: 00000100:00100000:3.0:1787432634.131951:0:8502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432634.132071:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812760832 00000100:00100000:1.0:1787432634.132078:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812760832 00000100:00100000:1.0:1787432634.132125:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787432634.132134:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:8502:x1874258812760832:12345-0@lo:502: 00000100:00100000:1.0:1787432634.132346:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:8502:x1874258812760832:12345-0@lo:502: Request processed in 212us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432634.132353:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787432634.132740:0:8502:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787432634.132761:0:8502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb992a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8502:1874258812760832:0@lo:502: 00000040:00080000:3.0:1787432634.132788:0:8502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787432634.133519:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787432634.133559:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787432634.133578:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba416800/0xbcb9e331c3f0fa4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa56 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.133592:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bba416800/0xbcb9e331c3f0fa4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa56 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432634.133604:0:5864:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787432634.133607:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787432634.133610:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787432634.133702:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba417000/0xbcb9e331c3f0fa5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.133726:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bba417000/0xbcb9e331c3f0fa5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.133738:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bba417000/0xbcb9e331c3f0fa5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432634.133760:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812760960:0@lo:101: 00000100:00100000:1.0:1787432634.133819:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432634.133860:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432634.134092:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812760960 00000100:00100000:2.0:1787432634.134101:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812760960 00000100:00100000:2.0:1787432634.134275:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787432634.134285:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+13:5864:x1874258812760960:12345-0@lo:101: 00010000:00010000:2.0:1787432634.134313:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432634.134330:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0fa64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0fa5d expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.134359:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0fa64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fa5d expref: 14 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.134371:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0fa64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fa5d expref: 14 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.134381:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bb5211600, rc 0) 00000100:00100000:2.0:1787432634.134436:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:5864:x1874258812760960:12345-0@lo:101: Request processed in 152us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432634.134445:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787432634.134529:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812760960:0@lo:101: 00010000:00010000:1.0:1787432634.134550:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bba417000/0xbcb9e331c3f0fa5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa64 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.134560:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bba417000/0xbcb9e331c3f0fa5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fa64 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432634.134621:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812761088:0@lo:501: 00000100:00100000:1.0:1787432634.134701:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432634.140239:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432634.145401:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812761088 00000100:00100000:0.0:1787432634.145425:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812761088 00000100:00100000:0.0:1787432634.145538:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787432634.145551:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:5864:x1874258812761088:12345-0@lo:501: 00000100:00100000:0.0:1787432634.146108:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:5864:x1874258812761088:12345-0@lo:501: Request processed in 557us (11403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432634.146118:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787432634.166380:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812761088:0@lo:501: 00000100:00100000:1.0:1787432634.166481:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812761216:0@lo:503: 00000100:00100000:1.0:1787432634.166623:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432634.166878:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432634.171600:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812761216 00000100:00100000:0.0:1787432634.171627:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812761216 00000100:00100000:0.0:1787432634.171794:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787432634.171810:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:5864:x1874258812761216:12345-0@lo:503: 00000100:00100000:0.0:1787432634.172205:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:5864:x1874258812761216:12345-0@lo:503: Request processed in 399us (5581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432634.172215:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787432634.173126:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812761216:0@lo:503: 00000100:00100000:1.0:1787432634.175816:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8503:1874258812761344:0@lo:502: 00000100:00100000:1.0:1787432634.175941:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432634.175996:0:8503:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba81a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432634.176267:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812761344 00000100:00100000:0.0:1787432634.176278:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812761344 00000100:00100000:0.0:1787432634.176353:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787432634.176365:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:8503:x1874258812761344:12345-0@lo:502: 00000100:00100000:0.0:1787432634.177536:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:8503:x1874258812761344:12345-0@lo:502: Request processed in 1162us (1584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432634.177553:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787432634.178498:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8503:1874258812761344:0@lo:502: 00000020:01000000:1.0:1787432634.178560:0:8503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432634.178587:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432634.178591:0:8503:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787432634.178599:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787432634.178652:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8503:1874258812761472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432634.178776:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432634.178838:0:8503:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba81a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432634.178980:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812761472 00000100:00100000:2.0:1787432634.178989:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812761472 00000100:00100000:2.0:1787432634.179065:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787432634.179077:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:8503:x1874258812761472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432634.180029:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:8503:x1874258812761472:12345-0@lo:502:llog_process_th.0 Request processed in 947us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432634.180041:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787432634.182835:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8503:1874258812761472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787432634.182906:0:8503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432634.182920:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432634.182922:0:8503:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787432634.182927:0:8503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787432634.185341:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787432634.185400:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787432634.185418:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba417000/0xbcb9e331c3f0fa5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa64 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.185435:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bba417000/0xbcb9e331c3f0fa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa64 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432634.185477:0:5864:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787432634.185481:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff935bbb3e4800 from 39 10000000:01000000:2.0:1787432634.185485:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787432634.185552:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bb5211a00/0xbcb9e331c3f0fa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.185562:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bb5211a00/0xbcb9e331c3f0fa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.185583:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bb5211a00/0xbcb9e331c3f0fa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432634.185621:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812761600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787432634.185779:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432634.185836:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b916796c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432634.187705:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812761600 00000100:00100000:0.0:1787432634.187726:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812761600 00000100:00100000:0.0:1787432634.187820:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787432634.187833:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:5864:x1874258812761600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432634.187873:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432634.187898:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935b80031000/0xbcb9e331c3f0fa72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0fa6b expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.187935:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935b80031000/0xbcb9e331c3f0fa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fa6b expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.187947:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935b80031000/0xbcb9e331c3f0fa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fa6b expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.187959:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80031000, rc 0) 00000100:00100000:0.0:1787432634.188083:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:5864:x1874258812761600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 253us (2303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432634.188091:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787432634.189841:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812761600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432634.189876:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bb5211a00/0xbcb9e331c3f0fa6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa72 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.189890:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bb5211a00/0xbcb9e331c3f0fa6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fa72 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432634.190001:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb992a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812761728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432634.190105:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432634.190158:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179c540 going to sleep for 11 seconds 00000100:00100000:2.0:1787432634.192561:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812761728 00000100:00100000:2.0:1787432634.192581:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812761728 00000100:00100000:2.0:1787432634.192702:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787432634.192715:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87907850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:5864:x1874258812761728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432634.193147:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87907850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:5864:x1874258812761728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 433us (3041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432634.193157:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787432634.194005:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb992a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812761728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432634.194093:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb992a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812761856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432634.194180:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432634.194236:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179c540 going to sleep for 11 seconds 00000100:00100000:3.0:1787432634.194265:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812761856 00000100:00100000:3.0:1787432634.194271:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812761856 00000100:00100000:3.0:1787432634.194321:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787432634.194330:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:5864:x1874258812761856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432634.194539:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:5864:x1874258812761856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 209us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432634.194546:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787432634.199740:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb992a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812761856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432634.201250:0:8504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa63b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8504:1874258812761984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432634.201377:0:8504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432634.201436:0:8504:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b8687c780 going to sleep for 11 seconds 00000100:00100000:3.0:1787432634.201584:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812761984 00000100:00100000:3.0:1787432634.201594:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812761984 00000100:00100000:3.0:1787432634.201687:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787432634.201699:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:8504:x1874258812761984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432634.202031:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:8504:x1874258812761984:12345-0@lo:502:llog_process_th.0 Request processed in 333us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432634.202040:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787432634.202622:0:8504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa63b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8504:1874258812761984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432634.202736:0:8504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8504:1874258812762112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432634.202794:0:8504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432634.202843:0:8504:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba81acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432634.203104:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812762112 00000100:00100000:3.0:1787432634.203112:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812762112 00000100:00100000:3.0:1787432634.203169:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787432634.203180:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87904450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:8504:x1874258812762112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432634.203449:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87904450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:8504:x1874258812762112:12345-0@lo:502:llog_process_th.0 Request processed in 269us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432634.203457:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787432634.203949:0:8504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8504:1874258812762112:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787432634.203985:0:8504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787432634.205978:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787432634.206035:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787432634.206051:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bb5211a00/0xbcb9e331c3f0fa6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa72 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.206066:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bb5211a00/0xbcb9e331c3f0fa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa72 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432634.206098:0:5864:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787432634.206101:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787432634.206105:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787432634.206222:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2166c00/0xbcb9e331c3f0fa79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.206315:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bc2166c00/0xbcb9e331c3f0fa79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.206330:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bc2166c00/0xbcb9e331c3f0fa79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432634.206363:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9929500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812762240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787432634.206459:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432634.206563:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432634.219583:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812762240 00000100:00100000:0.0:1787432634.219604:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812762240 00000100:00100000:0.0:1787432634.219716:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787432634.219730:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:5864:x1874258812762240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432634.219753:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432634.219778:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935b80030200/0xbcb9e331c3f0fa80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0fa79 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.219817:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935b80030200/0xbcb9e331c3f0fa80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fa79 expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.219829:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935b80030200/0xbcb9e331c3f0fa80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fa79 expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.219859:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80030200, rc 0) 00000100:00100000:0.0:1787432634.219967:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:5864:x1874258812762240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 241us (13508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432634.219974:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787432634.220183:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9929500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812762240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432634.220209:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bc2166c00/0xbcb9e331c3f0fa79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa80 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.220222:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bc2166c00/0xbcb9e331c3f0fa79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fa80 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432634.220332:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812762368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432634.220386:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432634.220438:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba81acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432634.220562:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812762368 00000100:00100000:0.0:1787432634.220620:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812762368 00000100:00100000:0.0:1787432634.220714:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787432634.220724:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87906c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:5864:x1874258812762368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432634.221088:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87906c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:5864:x1874258812762368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 365us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432634.221096:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787432634.221202:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812762368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432634.221259:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812762496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432634.221311:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432634.221341:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba81acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432634.223398:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812762496 00000100:00100000:0.0:1787432634.223420:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812762496 00000100:00100000:0.0:1787432634.223611:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787432634.223625:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:5864:x1874258812762496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432634.223959:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:5864:x1874258812762496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 337us (2646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432634.223968:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787432634.232629:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812762496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432634.241114:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8505:1874258812762624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432634.241256:0:8505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432634.241315:0:8505:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b987cc840 going to sleep for 11 seconds 00000100:00100000:1.0:1787432634.241446:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812762624 00000100:00100000:1.0:1787432634.241457:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812762624 00000100:00100000:1.0:1787432634.241524:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787432634.241536:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:8505:x1874258812762624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432634.241854:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:8505:x1874258812762624:12345-0@lo:502:llog_process_th.0 Request processed in 318us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432634.241863:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787432634.244781:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8505:1874258812762624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432634.244874:0:8505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432634.244889:0:8505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432634.244892:0:8505:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787432634.244900:0:8505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787432634.244955:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8505:1874258812762752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432634.245061:0:8505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432634.245114:0:8505:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b987cc840 going to sleep for 11 seconds 00000100:00100000:1.0:1787432634.245241:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812762752 00000100:00100000:1.0:1787432634.245251:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812762752 00000100:00100000:1.0:1787432634.245308:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787432634.245318:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87905c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:8505:x1874258812762752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432634.245600:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87905c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:8505:x1874258812762752:12345-0@lo:502:llog_process_th.0 Request processed in 283us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432634.245610:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787432634.247884:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8505:1874258812762752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432634.247948:0:8505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432634.247962:0:8505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432634.247965:0:8505:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787432634.247971:0:8505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1787432634.248207:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787432634.248246:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787432634.248262:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2166c00/0xbcb9e331c3f0fa79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa80 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.248294:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bc2166c00/0xbcb9e331c3f0fa79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa80 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432634.248317:0:5864:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787432634.248321:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff935b90e92000 from 39 10000000:01000000:1.0:1787432634.248324:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787432634.248372:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba416e00/0xbcb9e331c3f0fa87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.248381:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bba416e00/0xbcb9e331c3f0fa87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.248391:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bba416e00/0xbcb9e331c3f0fa87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432634.248417:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812762880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787432634.248506:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432634.248566:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba81ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432634.248815:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812762880 00000100:00100000:2.0:1787432634.248824:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812762880 00000100:00100000:2.0:1787432634.248875:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787432634.248886:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87904050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:5864:x1874258812762880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432634.248903:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432634.248922:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bb5211800/0xbcb9e331c3f0fa8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0fa87 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.248953:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bb5211800/0xbcb9e331c3f0fa8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fa87 expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.248965:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bb5211800/0xbcb9e331c3f0fa8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fa87 expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.248976:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bb5211800, rc 0) 00000100:00100000:2.0:1787432634.249040:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87904050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812762880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432634.249059:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787432634.249206:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812762880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432634.249223:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bba416e00/0xbcb9e331c3f0fa87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa8e expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.249244:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bba416e00/0xbcb9e331c3f0fa87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fa8e expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432634.249316:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812763008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432634.249344:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432634.249382:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba81ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432634.249475:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812763008 00000100:00100000:2.0:1787432634.249480:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812763008 00000100:00100000:2.0:1787432634.249509:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787432634.249516:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87905850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812763008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432634.249897:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87905850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812763008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 380us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432634.249905:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787432634.250066:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812763008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432634.250107:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812763136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432634.250153:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432634.250186:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba81ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432634.255566:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812763136 00000100:00100000:2.0:1787432634.255590:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812763136 00000100:00100000:2.0:1787432634.255700:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787432634.255714:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812763136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432634.256054:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812763136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 342us (5898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432634.256063:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787432634.256195:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812763136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432634.257684:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb992bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8506:1874258812763264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432634.257785:0:8506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432634.257832:0:8506:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432634.257913:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812763264 00000100:00100000:2.0:1787432634.257921:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812763264 00000100:00100000:2.0:1787432634.257972:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787432634.257983:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:8506:x1874258812763264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432634.258287:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:8506:x1874258812763264:12345-0@lo:502:llog_process_th.0 Request processed in 305us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432634.258295:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787432634.262324:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb992bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8506:1874258812763264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432634.262461:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8506:1874258812763392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432634.262565:0:8506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432634.262596:0:8506:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba81ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432634.262829:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812763392 00000100:00100000:2.0:1787432634.262839:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812763392 00000100:00100000:2.0:1787432634.262882:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787432634.262892:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:8506:x1874258812763392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432634.263315:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:8506:x1874258812763392:12345-0@lo:502:llog_process_th.0 Request processed in 421us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432634.263325:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787432634.263612:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8506:1874258812763392:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787432634.263645:0:8506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787432634.263981:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787432634.264008:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787432634.264033:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba416e00/0xbcb9e331c3f0fa87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa8e expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.264046:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bba416e00/0xbcb9e331c3f0fa87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa8e expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432634.264073:0:5864:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787432634.264077:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787432634.264080:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787432634.264122:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0fa95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.264131:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0fa95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.264143:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0fa95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432634.264168:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812763520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787432634.264254:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432634.264301:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87099b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432634.264601:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812763520 00000100:00100000:1.0:1787432634.264610:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812763520 00000100:00100000:1.0:1787432634.264714:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787432634.264726:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812763520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432634.264742:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432634.264760:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba416400/0xbcb9e331c3f0fa9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0fa95 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.264790:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba416400/0xbcb9e331c3f0fa9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fa95 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.264801:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba416400/0xbcb9e331c3f0fa9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fa95 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432634.264824:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba416400, rc 0) 00000100:00100000:1.0:1787432634.264886:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812763520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432634.264894:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787432634.265008:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812763520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432634.265037:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0fa95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa9c expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.265046:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0fa95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fa9c expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432634.265116:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb992bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812763648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432634.265151:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432634.265196:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179c780 going to sleep for 11 seconds 00000100:00100000:1.0:1787432634.265324:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812763648 00000100:00100000:1.0:1787432634.265329:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812763648 00000100:00100000:1.0:1787432634.265361:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787432634.265368:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87906850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812763648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432634.265719:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87906850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812763648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 350us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432634.265727:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787432634.265880:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb992bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812763648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432634.265914:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb992bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812763776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432634.265957:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432634.265991:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179c780 going to sleep for 11 seconds 00000100:00100000:0.0:1787432634.266068:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812763776 00000100:00100000:0.0:1787432634.266073:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812763776 00000100:00100000:0.0:1787432634.266112:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787432634.266121:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812763776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432634.266312:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812763776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 192us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432634.266319:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787432634.266479:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb992bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812763776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432634.268630:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8507:1874258812763904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432634.268795:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432634.268849:0:8507:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87826b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432634.269005:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812763904 00000100:00100000:0.0:1787432634.269025:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812763904 00000100:00100000:0.0:1787432634.269092:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787432634.269103:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:8507:x1874258812763904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432634.270020:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:8507:x1874258812763904:12345-0@lo:502:llog_process_th.0 Request processed in 902us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432634.270043:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787432634.282369:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8507:1874258812763904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787432634.282893:0:8507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432634.282915:0:8507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432634.282918:0:8507:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787432634.282926:0:8507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787432634.282988:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb992bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8507:1874258812764032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432634.283105:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432634.283163:0:8507:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179c780 going to sleep for 11 seconds 00000100:00100000:1.0:1787432634.283242:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812764032 00000100:00100000:1.0:1787432634.283252:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812764032 00000100:00100000:1.0:1787432634.283325:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787432634.283336:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:8507:x1874258812764032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432634.283750:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:8507:x1874258812764032:12345-0@lo:502:llog_process_th.0 Request processed in 415us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432634.283759:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787432634.283956:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb992bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8507:1874258812764032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432634.283989:0:8507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432634.283996:0:8507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432634.283998:0:8507:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787432634.284002:0:8507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787432634.284123:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1787432634.284147:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787432634.284160:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0fa95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa9c expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.284174:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0fa95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa9c expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432634.284186:0:5864:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787432634.284190:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff935b879b0000 from 1 10000000:01000000:3.0:1787432634.284193:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787432634.284228:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2166200/0xbcb9e331c3f0faa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.284236:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bc2166200/0xbcb9e331c3f0faa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.284256:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bc2166200/0xbcb9e331c3f0faa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432634.284275:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9929500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812764160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787432634.284330:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432634.284366:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432634.284423:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812764160 00000100:00100000:0.0:1787432634.284429:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812764160 00000100:00100000:0.0:1787432634.284473:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787432634.284482:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812764160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432634.284493:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432634.284508:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0faaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0faa3 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.284531:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0faaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0faa3 expref: 19 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.284541:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0faaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0faa3 expref: 19 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432634.284551:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80030400, rc 0) 00000100:00100000:0.0:1787432634.284594:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812764160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432634.284600:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787432634.285373:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9929500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812764160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432634.285468:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bc2166200/0xbcb9e331c3f0faa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0faaa expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.285482:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bc2166200/0xbcb9e331c3f0faa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0faaa expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432634.285560:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812764288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432634.285622:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432634.285703:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812764288 00000100:00100000:3.0:1787432634.285710:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812764288 00000100:00100000:3.0:1787432634.285754:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787432634.285765:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812764288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432634.286119:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87826b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432634.286222:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812764288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 457us (597us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787432634.286231:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787432634.286489:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812764288:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787432634.286530:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787432634.286539:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2166200/0xbcb9e331c3f0faa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0faaa expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432634.286559:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bc2166200/0xbcb9e331c3f0faa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0faaa expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432634.489982:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432635.510056:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432636.534230:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432636.663224:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3331:1874258812764672:0@lo:400:kworker.0 00000100:00100000:1.0:1787432636.663368:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432636.663490:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787432636.663514:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3331:1874258812764544:0@lo:400:kworker.0 00000100:00100000:1.0:1787432636.663542:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432636.663561:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812765056:0@lo:400:kworker.0 00000100:00100000:1.0:1787432636.663605:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432636.663649:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812765056 00000100:00100000:1.0:1787432636.663699:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812765056 00000100:00100000:3.0:1787432636.666437:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812764416:0@lo:400:kworker.0 00000100:00100000:3.0:1787432636.666572:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432636.666654:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3333:1874258812764928:0@lo:400:kworker.0 00000100:00100000:3.0:1787432636.666740:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432636.667220:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787432636.667246:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812765056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432636.667359:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812765056:12345-0@lo:400:kworker.0 Request processed in 126us (3751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432636.667369:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787432636.667458:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbae5a680 x1874258812765056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432636.667479:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812765056:0@lo:400:kworker.0 00000100:00100000:0.0:1787432636.668160:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812764800:0@lo:400:kworker.0 00000100:00100000:0.0:1787432636.668221:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432636.668281:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812764800 00000100:00100000:0.0:1787432636.668289:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812764800 00000100:00100000:0.0:1787432636.668350:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787432636.668359:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812764800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432636.668405:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812764800:12345-0@lo:400:kworker.0 Request processed in 48us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432636.668440:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787432636.668499:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbae59f80 x1874258812764800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432636.668510:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812764800:0@lo:400:kworker.0 00000100:00080000:2.0:1787432636.668926:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787432636.668934:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432636.668953:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812764416 00000100:00100000:2.0:1787432636.668959:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812764416 00000100:00100000:1.0:1787432636.670202:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812764672 00000100:00100000:1.0:1787432636.670226:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812764672 00000100:00100000:1.0:1787432636.670302:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812764544 00000100:00100000:1.0:1787432636.670306:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812764544 00000100:00100000:1.0:1787432636.670329:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812764928 00000100:00100000:1.0:1787432636.670332:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812764928 00000100:00100000:1.0:1787432636.670361:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787432636.670371:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3331:x1874258812764672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432636.670463:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3331:x1874258812764672:12345-0@lo:400:kworker.0 Request processed in 94us (7095us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432636.670472:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787432636.670491:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787432636.670498:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3331:x1874258812764544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432636.670529:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3331:x1874258812764544:12345-0@lo:400:kworker.0 Request processed in 32us (6987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432636.670535:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787432636.670565:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787432636.670570:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb992a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1874258812764928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432636.670606:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb992a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1874258812764928:12345-0@lo:400:kworker.0 Request processed in 36us (3866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432636.670613:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787432636.670639:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432636.670723:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3331:1874258812764544:0@lo:400:kworker.0 00000100:00100000:1.0:1787432636.670737:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3331:1874258812764672:0@lo:400:kworker.0 00000100:00100000:2.0:1787432636.676524:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787432636.676542:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3333:x1874258812764416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432636.676703:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3333:x1874258812764416:12345-0@lo:400:kworker.0 Request processed in 165us (10132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432636.676711:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787432636.676829:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812764416:0@lo:400:kworker.0 00000100:00100000:2.0:1787432636.676855:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3333:1874258812764928:0@lo:400:kworker.0 00000100:00100000:3.0:1787432636.846175:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432636.847000:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791764864 00000100:00100000:1.0:1787432636.847018:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791764864 00000100:00100000:1.0:1787432636.847103:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 166 00000100:00100000:1.0:1787432636.847116:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+8:5619:x1874258791764864:12345-192.168.202.15@tcp:101: 00010000:00010000:1.0:1787432636.847140:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432636.847166:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba416c00/0xbcb9e331c3f0fab1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a025b19 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432636.847205:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba416c00/0xbcb9e331c3f0fab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b19 expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432636.847218:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba416c00/0xbcb9e331c3f0fab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b19 expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432636.847230:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba416c00, rc 0) 00000100:00100000:1.0:1787432636.847331:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+9:5619:x1874258791764864:12345-192.168.202.15@tcp:101: Request processed in 217us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432636.847338:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 166 00000100:00100000:3.0:1787432636.853134:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432636.853246:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791764992 00000100:00100000:1.0:1787432636.853280:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791764992 00000100:00100000:1.0:1787432636.853361:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 167 00000100:00100000:1.0:1787432636.853375:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+9:5619:x1874258791764992:12345-192.168.202.15@tcp:501: 00000100:00100000:1.0:1787432636.853834:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+9:5619:x1874258791764992:12345-192.168.202.15@tcp:501: Request processed in 459us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432636.853845:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 167 00000100:00100000:3.0:1787432636.855947:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432636.856140:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791765120 00000100:00100000:2.0:1787432636.856152:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791765120 00000100:00100000:2.0:1787432636.856226:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 168 00000100:00100000:2.0:1787432636.856238:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+9:5619:x1874258791765120:12345-192.168.202.15@tcp:503: 00000100:00100000:2.0:1787432636.856546:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+9:5619:x1874258791765120:12345-192.168.202.15@tcp:503: Request processed in 309us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432636.856555:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 168 00000100:00100000:0.0:1787432636.861148:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432636.861348:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791765248 00000100:00100000:3.0:1787432636.861364:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791765248 00000100:00100000:3.0:1787432636.861453:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 169 00000100:00100000:3.0:1787432636.861467:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+9:6103:x1874258791765248:12345-192.168.202.15@tcp:502: 00000100:00100000:3.0:1787432636.862506:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+9:6103:x1874258791765248:12345-192.168.202.15@tcp:502: Request processed in 1032us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432636.862518:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 169 00000100:00100000:3.0:1787432636.867565:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432636.867715:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791765376 00000100:00100000:1.0:1787432636.867729:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791765376 00000100:00100000:1.0:1787432636.867803:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 170 00000100:00100000:1.0:1787432636.867816:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+9:6103:x1874258791765376:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787432636.869513:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+9:6103:x1874258791765376:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 1685us (1952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432636.869531:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 170 00000100:00100000:1.0:1787432636.883625:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432636.883748:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791765504 00000100:00100000:2.0:1787432636.883761:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791765504 00000100:00100000:2.0:1787432636.883822:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 171 00000100:00100000:2.0:1787432636.883832:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+9:5619:x1874258791765504:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432636.883888:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432636.883922:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bb5210400/0xbcb9e331c3f0fab8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a025b20 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432636.883959:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bb5210400/0xbcb9e331c3f0fab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b20 expref: 10 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432636.883978:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bb5210400/0xbcb9e331c3f0fab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b20 expref: 10 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432636.883997:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bb5210400, rc 0) 00000100:00100000:2.0:1787432636.884092:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:5619:x1874258791765504:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 259us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432636.884100:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 171 00000100:00100000:0.0:1787432636.889556:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432636.889779:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791765632 00000100:00100000:1.0:1787432636.889797:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791765632 00000100:00100000:1.0:1787432636.889890:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 172 00000100:00100000:1.0:1787432636.890152:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:5619:x1874258791765632:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432636.890883:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:5619:x1874258791765632:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 978us (1341us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787432636.890897:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 172 00000100:00100000:1.0:1787432637.175063:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812765184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432637.175170:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432637.176151:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812765184 00000100:00100000:1.0:1787432637.176168:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812765184 00000100:00100000:1.0:1787432637.176248:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787432637.176259:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812765184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787432637.176306:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432637.176381:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812765184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432637.176388:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787432637.176442:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa50e00 x1874258812765184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432637.176464:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812765184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432637.178283:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812765312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432637.178359:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432637.178422:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812765312 00000100:00100000:2.0:1787432637.178431:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812765312 00000100:00100000:2.0:1787432637.178477:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787432637.178485:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812765312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432637.178523:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432637.178575:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812765312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432637.178585:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787432637.178630:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbae58e00 x1874258812765312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432637.178650:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812765312:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787432637.562297:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787432637.819423:0:8545:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffae3abfe0 20000000:00000080:0.0:1787432637.819729:0:8545:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff935bb986b400 uarg=0000000000000000 20000000:01000000:0.0:1787432637.819789:0:8545:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787432637.819800:0:8545:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787432637.819807:0:8545:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787432637.821363:0:8546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787432637.821917:0:8545:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787432637.831463:0:8545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787432637.831564:0:8545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787432637.831647:0:8545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787432637.832957:0:8545:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787432637.833273:0:8545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff935bba416200/0xbcb9e331c3f0fabf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432637.833299:0:8545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f0f834 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f82d expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432637.833308:0:8545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bc2166000/0xbcb9e331c3f0f896 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f88f expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432637.833315:0:8545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935b80031c00/0xbcb9e331c3f0f961 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0f95a expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432637.833327:0:8545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bc2154e00/0xbcb9e331c3f0fa1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ae8 expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432637.833335:0:8545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff935bba416200/0xbcb9e331c3f0fabf lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432637.833417:0:8545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bc2154e00/0xbcb9e331c3f0fa1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ae8 expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432637.833440:0:8545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff935bc2154e00/0xbcb9e331c3f0fa1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ae8 expref: 9 pid: 5862 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432637.833466:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8545:1874258812765440:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787432637.833631:0:8545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935b80031c00/0xbcb9e331c3f0f961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f95a expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432637.833641:0:8545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935b80031c00/0xbcb9e331c3f0f961 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f95a expref: 18 pid: 5862 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432637.833651:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa51500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8545:1874258812765568:0@lo:104: 00000100:00100000:1.0:1787432637.841824:0:8545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787432637.841995:0:8545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bc2166000/0xbcb9e331c3f0f896 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f88f expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432637.842016:0:8545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bc2166000/0xbcb9e331c3f0f896 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f88f expref: 18 pid: 5861 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432637.842036:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa51c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8545:1874258812765696:0@lo:104: 00000100:00100000:1.0:1787432637.842124:0:8545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787432637.842167:0:8545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f0f834 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0f82d expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432637.842176:0:8545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f0f834 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f82d expref: 18 pid: 5861 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432637.842211:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8545:1874258812765824:0@lo:104: 00000100:00100000:3.0:1787432637.842227:0:5849:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787432637.842236:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba81a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787432637.842246:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432637.842261:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812765568 00000100:00100000:3.0:1787432637.842269:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812765568 00000100:00100000:3.0:1787432637.842323:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812765696 00000100:00100000:3.0:1787432637.842327:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812765696 00000100:00100000:3.0:1787432637.842337:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812765824 00000100:00100000:3.0:1787432637.842340:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812765824 00000100:00100000:3.0:1787432637.842352:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787432637.842362:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+5:8545:x1874258812765568:12345-0@lo:104: 00010000:00010000:3.0:1787432637.842378:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f0f95a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f961 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432637.842462:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787432637.842470:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+5:8545:x1874258812765568:12345-0@lo:104: Request processed in 109us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432637.842478:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1787432637.842760:0:5855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432637.842770:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f0f95a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f961 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.842779:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154a00 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:0.0:1787432637.842785:0:5855:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f0f95a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f961 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.842795:0:5855:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f0f95a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f961 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432637.842803:0:5855:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f0f95a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f961 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432637.842810:0:5855:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787432637.842867:0:5855:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f0f95a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f961 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.842874:0:5855:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432637.842910:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f0f95a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f961 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.842917:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f0f95a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f961 expref: -99 pid: 7666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.842935:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432637.842937:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432637.842939:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432637.843029:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787432637.843042:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b9118f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+5:8545:x1874258812765696:12345-0@lo:104: 00010000:00010000:2.0:1787432637.843052:0:5850:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bc2154000/0xbcb9e331c3f0f88f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f896 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432637.843112:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787432637.843118:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b9118f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+5:8545:x1874258812765696:12345-0@lo:104: Request processed in 81us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432637.843125:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787432637.843149:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787432637.843155:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb992b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+4:8545:x1874258812765824:12345-0@lo:104: 00010000:00010000:2.0:1787432637.843163:0:5850:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f0f82d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f834 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432637.843199:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787432637.843204:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb992b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+4:8545:x1874258812765824:12345-0@lo:104: Request processed in 50us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432637.843209:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787432637.843235:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812765952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432637.843269:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787432637.843314:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787432637.843319:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bc2154000/0xbcb9e331c3f0f88f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f896 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432637.843322:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812765952 00010000:00010000:0.0:1787432637.843326:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154000 already unused, calling callback (ffffffffc1d6fc20) 00000100:00100000:2.0:1787432637.843329:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812765952 10000000:00010000:0.0:1787432637.843330:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bc2154000/0xbcb9e331c3f0f88f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f896 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.843337:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bc2154000/0xbcb9e331c3f0f88f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f896 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432637.843343:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bc2154000/0xbcb9e331c3f0f88f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f896 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432637.843348:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787432637.843353:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935b80031c00/0xbcb9e331c3f0f961 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f95a expref: 19 pid: 5862 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.843377:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bc2154000/0xbcb9e331c3f0f88f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f896 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432637.843379:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787432637.843384:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787432637.843385:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3333:x1874258812765952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432637.843406:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432637.843410:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bc2154000/0xbcb9e331c3f0f88f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f896 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432637.843413:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935b80031c00/0xbcb9e331c3f0f961 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f95a expref: 19 pid: 5862 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.843417:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bc2154000/0xbcb9e331c3f0f88f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f896 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432637.843423:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935b80031c00/0xbcb9e331c3f0f961 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f95a expref: 19 pid: 5862 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.843428:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432637.843431:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f0f82d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0f834 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.843436:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154600 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:0.0:1787432637.843439:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f0f82d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0f834 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432637.843445:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787432637.843455:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f0f82d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0f834 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432637.843463:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f0f82d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0f834 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432637.843469:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787432637.843471:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3333:x1874258812765952:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432637.843478:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787432637.843482:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f0f82d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f834 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.843499:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432637.843506:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f0f82d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f834 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.843512:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f0f82d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0f834 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432637.843518:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812765952:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432637.843525:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432637.843531:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432637.843533:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432637.843535:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432637.843617:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812766080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432637.843645:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432637.843699:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432637.843705:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812766208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432637.843708:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8545:1874258812765440:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787432637.843719:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935b80031c00/0xbcb9e331c3f0f961 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f95a expref: 18 pid: 5862 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432637.843727:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432637.843734:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa51500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8545:1874258812765568:0@lo:104: 00000100:00100000:1.0:1787432637.843743:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa51c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8545:1874258812765696:0@lo:104: 00000100:00100000:1.0:1787432637.843750:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8545:1874258812765824:0@lo:104: 00010000:00010000:1.0:1787432637.843791:0:8545:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff935bba416200/0xbcb9e331c3f0fabf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432637.844160:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812766080 00000100:00100000:2.0:1787432637.844167:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812766080 00010000:00010000:2.0:1787432637.844189:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bc2166000/0xbcb9e331c3f0f896 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f88f expref: 18 pid: 5861 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432637.844219:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812766208 00000100:00100000:2.0:1787432637.844222:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812766208 00010000:00010000:2.0:1787432637.844234:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f0f834 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f82d expref: 19 pid: 5861 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432637.844259:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787432637.844266:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812766080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432637.844276:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787432637.844281:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1787432637.844282:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bc2166000/0xbcb9e331c3f0f896 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f88f expref: 19 pid: 5861 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432637.844291:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812766208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787432637.844298:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432637.844302:0:8489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f0f834 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f82d expref: 19 pid: 5861 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432637.844305:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bc2166000/0xbcb9e331c3f0f896 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f88f expref: 19 pid: 5861 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432637.844319:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bc2166000/0xbcb9e331c3f0f896 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f88f expref: 19 pid: 5861 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432637.844321:0:8489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f0f834 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0f82d expref: 19 pid: 5861 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432637.844330:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f0f834 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0f82d expref: 18 pid: 5861 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432637.844331:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432637.844340:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432637.844460:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:3330:x1874258812766208:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432637.844468:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787432637.845233:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:3330:x1874258812766080:12345-0@lo:103:ldlm_bl.0 Request processed in 964us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432637.845243:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787432637.845273:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812766208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432637.845294:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812766080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432637.848067:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432637.848156:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791765760 00000100:00100000:0.0:1787432637.848170:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791765760 00010000:00010000:0.0:1787432637.848234:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bc2154e00/0xbcb9e331c3f0fa1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ae8 expref: 10 pid: 5862 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432637.848288:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:0.0:1787432637.848299:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2376:x1874258791765760:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432637.848318:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432637.848325:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bc2154e00/0xbcb9e331c3f0fa1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ae8 expref: 10 pid: 5862 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.848340:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bc2154e00/0xbcb9e331c3f0fa1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ae8 expref: 10 pid: 5862 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.848364:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bc2154e00/0xbcb9e331c3f0fa1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ae8 expref: 10 pid: 5862 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.848390:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff935bba416200/0xbcb9e331c3f0fabf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.848420:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba416200/0xbcb9e331c3f0fabf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.848441:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935bba416200/0xbcb9e331c3f0fabf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.848460:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935bba416200/0xbcb9e331c3f0fabf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.848468:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff935bba416200/0xbcb9e331c3f0fabf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.848475:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff935bba416200/0xbcb9e331c3f0fabf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.848482:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba416200 already unused, calling callback (ffffffffc1752230) 00010000:00010000:0.0:1787432637.848495:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff935bba416200/0xbcb9e331c3f0fabf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.848504:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff935bba416200/0xbcb9e331c3f0fabf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.848526:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff935bba416200/0xbcb9e331c3f0fabf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432637.848539:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432637.848629:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+9:2376:x1874258791765760:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 330us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432637.848639:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 24 00010000:00010000:1.0:1787432637.849019:0:8545:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff935bba416200/0xbcb9e331c3f0fabf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432637.849028:0:8545:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff935bba416200/0xbcb9e331c3f0fabf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432637.849035:0:8545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bba416200/0xbcb9e331c3f0fabf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432638.384635:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432638.384748:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432638.384793:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432638.384831:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791766144 00000100:00100000:0.0:1787432638.384845:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791766144 00000100:00100000:3.0:1787432638.385063:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791766016 00000100:00100000:3.0:1787432638.385069:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791766016 00000100:00100000:3.0:1787432638.385124:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:3.0:1787432638.385137:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791766016:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432638.385200:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791765888 00000100:00100000:1.0:1787432638.385208:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791765888 00000100:00100000:3.0:1787432638.385251:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791766016:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 115us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432638.385258:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:3.0:1787432638.385264:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:1.0:1787432638.385270:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791765888:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432638.385314:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791765888:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 47us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432638.385345:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00080000:1.0:1787432638.385371:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787432638.385377:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787432638.385379:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432638.385940:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:3.0:1787432638.385953:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791766144:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432638.386029:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791766144:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 79us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432638.386035:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:1.0:1787432638.447361:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432638.447699:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791766272 00000100:00100000:3.0:1787432638.447716:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791766272 00000100:00100000:3.0:1787432638.447792:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 173 00000100:00100000:3.0:1787432638.447805:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+9:5619:x1874258791766272:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432638.447859:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432638.447895:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bc2166800/0xbcb9e331c3f0fac6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a025b27 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432638.447943:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bc2166800/0xbcb9e331c3f0fac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b27 expref: 10 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432638.447970:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bc2166800/0xbcb9e331c3f0fac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b27 expref: 10 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432638.447991:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2166800, rc 0) 00000100:00100000:3.0:1787432638.448072:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:5619:x1874258791766272:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 269us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432638.448081:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 173 00000100:00100000:3.0:1787432638.450787:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432638.450922:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791766400 00000100:00100000:1.0:1787432638.450936:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791766400 00000100:00100000:1.0:1787432638.451030:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 174 00000100:00100000:1.0:1787432638.451043:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:5619:x1874258791766400:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432638.451453:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:5619:x1874258791766400:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 410us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432638.451462:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 174 00000100:00100000:2.0:1787432638.460238:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432638.460356:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791766528 00000100:00100000:3.0:1787432638.460372:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791766528 00000100:00100000:3.0:1787432638.460457:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 175 00000100:00100000:3.0:1787432638.460469:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:5619:x1874258791766528:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432638.460837:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:5619:x1874258791766528:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 366us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432638.460847:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 175 00000100:00100000:0.0:1787432638.472254:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432638.472465:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791766656 00000100:00100000:3.0:1787432638.472480:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791766656 00000100:00100000:3.0:1787432638.472705:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 176 00000100:00100000:3.0:1787432638.472718:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:6160:x1874258791766656:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787432638.473095:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:6160:x1874258791766656:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 377us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432638.473105:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 176 00000100:00100000:2.0:1787432638.478498:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432638.478631:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791766784 00000100:00100000:0.0:1787432638.478644:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791766784 00000100:00100000:0.0:1787432638.478767:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 177 00000100:00100000:0.0:1787432638.478782:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:6160:x1874258791766784:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787432638.479230:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:6160:x1874258791766784:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 450us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432638.479239:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 177 00010000:00010000:0.0:1787432638.582934:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787432639.224117:0:5864:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787432639.224127:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff935bbb06d800 from 4 10000000:01000000:3.0:1787432639.224133:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787432639.224185:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2167200/0xbcb9e331c3f0facd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432639.224200:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bc2167200/0xbcb9e331c3f0facd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432639.224214:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bc2167200/0xbcb9e331c3f0facd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432639.224247:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb992b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812766336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787432639.224327:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432639.224374:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb9563c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432639.224402:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812766336 00000100:00100000:3.0:1787432639.224411:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812766336 00000100:00100000:3.0:1787432639.224470:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787432639.224480:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:5864:x1874258812766336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432639.224494:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432639.224507:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bc2167a00/0xbcb9e331c3f0fad4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0facd expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432639.224533:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bc2167a00/0xbcb9e331c3f0fad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0facd expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432639.224565:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bc2167a00/0xbcb9e331c3f0fad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0facd expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432639.224588:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2167a00, rc 0) 00000100:00100000:3.0:1787432639.224632:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812766336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432639.224640:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787432639.224710:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb992b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812766336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432639.224725:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bc2167200/0xbcb9e331c3f0facd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fad4 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432639.224734:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bc2167200/0xbcb9e331c3f0facd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fad4 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432639.224798:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb992b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812766464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432639.224824:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432639.224838:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb9563c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432639.224851:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812766464 00000100:00100000:3.0:1787432639.224854:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812766464 00000100:00100000:3.0:1787432639.224876:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787432639.224883:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812766464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432639.225210:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812766464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432639.225217:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787432639.225248:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb992b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812766464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432639.225283:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb992b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812766592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432639.225318:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432639.225332:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb9563c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432639.225345:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812766592 00000100:00100000:3.0:1787432639.225348:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812766592 00000100:00100000:3.0:1787432639.225369:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787432639.225376:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812766592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432639.225513:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812766592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432639.225520:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787432639.225563:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb992b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812766592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432639.236080:0:8607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8607:1874258812766720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432639.236176:0:8607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432639.236235:0:8607:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b878263c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432639.236780:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812766720 00000100:00100000:3.0:1787432639.236789:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812766720 00000100:00100000:3.0:1787432639.236837:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787432639.236847:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:8607:x1874258812766720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432639.237097:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:8607:x1874258812766720:12345-0@lo:502:llog_process_th.0 Request processed in 250us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432639.237106:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787432639.241039:0:8607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8607:1874258812766720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432639.241104:0:8607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432639.241121:0:8607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432639.241124:0:8607:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787432639.241135:0:8607:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff935bbb06d800 00000020:00000080:2.0:1787432639.241139:0:8607:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787432639.245088:0:8607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8607:1874258812766848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432639.245198:0:8607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432639.245239:0:8607:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b878263c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432639.245334:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812766848 00000100:00100000:3.0:1787432639.245343:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812766848 00000100:00100000:3.0:1787432639.245396:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787432639.245405:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:8607:x1874258812766848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432639.245617:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:8607:x1874258812766848:12345-0@lo:502:llog_process_th.0 Request processed in 212us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432639.245625:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787432639.248164:0:8607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8607:1874258812766848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432639.248224:0:8607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432639.248233:0:8607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432639.248236:0:8607:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787432639.248241:0:8607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787432639.252157:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787432639.252198:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432639.252213:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2167200/0xbcb9e331c3f0facd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fad4 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432639.252228:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bc2167200/0xbcb9e331c3f0facd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fad4 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432639.252240:0:5864:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787432639.252244:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff935bbb3e4800 from 4 10000000:01000000:2.0:1787432639.252246:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787432639.252294:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fe00/0xbcb9e331c3f0fadb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432639.252303:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fe00/0xbcb9e331c3f0fadb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432639.252314:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fe00/0xbcb9e331c3f0fadb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432639.252342:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812766976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787432639.252424:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432639.252473:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b878263c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432639.252496:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812766976 00000100:00100000:2.0:1787432639.252502:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812766976 00000100:00100000:2.0:1787432639.252559:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787432639.252569:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812766976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432639.252592:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432639.252604:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bbaa5f800/0xbcb9e331c3f0fae2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0fadb expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432639.252629:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bbaa5f800/0xbcb9e331c3f0fae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fadb expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432639.252639:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bbaa5f800/0xbcb9e331c3f0fae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fadb expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432639.252647:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f800, rc 0) 00000100:00100000:2.0:1787432639.252706:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812766976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432639.252713:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787432639.252765:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812766976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432639.252779:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fe00/0xbcb9e331c3f0fadb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fae2 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432639.252788:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fe00/0xbcb9e331c3f0fadb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fae2 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432639.252841:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812767104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432639.252866:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432639.252881:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b878263c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432639.252895:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812767104 00000100:00100000:2.0:1787432639.252898:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812767104 00000100:00100000:2.0:1787432639.252919:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787432639.252926:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812767104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432639.253214:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812767104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432639.253222:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787432639.253255:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812767104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432639.253283:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812767232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432639.253325:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432639.253340:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b8687c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432639.253353:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812767232 00000100:00100000:2.0:1787432639.253356:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812767232 00000100:00100000:2.0:1787432639.253379:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787432639.253386:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812767232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432639.253538:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812767232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432639.253544:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787432639.253585:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812767232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432639.253845:0:8609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8609:1874258812767360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432639.253881:0:8609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432639.253902:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812767360 00000100:00100000:2.0:1787432639.253905:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812767360 00000100:00100000:2.0:1787432639.253927:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787432639.253932:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:8609:x1874258812767360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432639.254067:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:8609:x1874258812767360:12345-0@lo:502:llog_process_th.0 Request processed in 133us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432639.254073:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787432639.254109:0:8609:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b878263c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432639.254121:0:8609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8609:1874258812767360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432639.254142:0:8609:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432639.254151:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432639.254154:0:8609:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787432639.254160:0:8609:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff935bbb3e4800 00000020:00000080:2.0:1787432639.254162:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787432639.254871:0:8609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8609:1874258812767488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432639.254918:0:8609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432639.254948:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812767488 00000100:00100000:2.0:1787432639.254952:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812767488 00000100:00100000:2.0:1787432639.272179:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787432639.272202:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:8609:x1874258812767488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432639.272468:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:8609:x1874258812767488:12345-0@lo:502:llog_process_th.0 Request processed in 274us (17548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432639.272477:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787432639.272542:0:8609:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2240 going to sleep for 11 seconds 00000100:00100000:2.0:1787432639.272571:0:8609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8609:1874258812767488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432639.272605:0:8609:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432639.272614:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432639.272616:0:8609:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787432639.272621:0:8609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787432639.273934:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787432639.273962:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432639.273986:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fe00/0xbcb9e331c3f0fadb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fae2 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432639.274000:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fe00/0xbcb9e331c3f0fadb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fae2 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432639.274017:0:5864:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787432639.274019:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff935b90e92000 from 4 10000000:01000000:2.0:1787432639.274023:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787432639.274062:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f400/0xbcb9e331c3f0fae9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432639.274071:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f400/0xbcb9e331c3f0fae9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432639.274081:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f400/0xbcb9e331c3f0fae9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432639.274106:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812767616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787432639.274166:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432639.274199:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2240 going to sleep for 11 seconds 00000100:00100000:2.0:1787432639.274220:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812767616 00000100:00100000:2.0:1787432639.274226:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812767616 00000100:00100000:2.0:1787432639.274266:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787432639.274275:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812767616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432639.274288:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432639.274302:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bbaa5e200/0xbcb9e331c3f0faf0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0fae9 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432639.274326:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bbaa5e200/0xbcb9e331c3f0faf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fae9 expref: 19 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432639.274337:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bbaa5e200/0xbcb9e331c3f0faf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fae9 expref: 19 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432639.274356:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e200, rc 0) 00000100:00100000:2.0:1787432639.274393:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812767616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432639.274399:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787432639.274441:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812767616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432639.274457:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f400/0xbcb9e331c3f0fae9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0faf0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432639.274465:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f400/0xbcb9e331c3f0fae9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0faf0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432639.274514:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812767744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432639.274539:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432639.274553:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2240 going to sleep for 11 seconds 00000100:00100000:2.0:1787432639.274565:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812767744 00000100:00100000:2.0:1787432639.274568:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812767744 00000100:00100000:2.0:1787432639.274589:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787432639.274595:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812767744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432639.275344:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812767744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 741us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432639.275353:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787432639.275385:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812767744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432639.275423:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812767872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432639.275465:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432639.275502:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2240 going to sleep for 11 seconds 00000100:00100000:2.0:1787432639.275517:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812767872 00000100:00100000:2.0:1787432639.275522:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812767872 00000100:00100000:2.0:1787432639.275551:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787432639.275559:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812767872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432639.275732:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812767872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432639.275739:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787432639.276924:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812767872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432639.277987:0:8611:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8611:1874258812768000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432639.278053:0:8611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432639.278086:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812768000 00000100:00100000:2.0:1787432639.278092:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812768000 00000100:00100000:2.0:1787432639.278133:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787432639.278142:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:8611:x1874258812768000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432639.278335:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:8611:x1874258812768000:12345-0@lo:502:llog_process_th.0 Request processed in 194us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432639.278345:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787432639.278396:0:8611:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2540 going to sleep for 11 seconds 00000100:00100000:2.0:1787432639.278412:0:8611:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8611:1874258812768000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432639.278439:0:8611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432639.278449:0:8611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432639.278451:0:8611:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787432639.278458:0:8611:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff935b90e92000 00000020:00000080:2.0:1787432639.278460:0:8611:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787432639.278997:0:8611:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8611:1874258812768128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432639.279048:0:8611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432639.279074:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812768128 00000100:00100000:2.0:1787432639.279078:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812768128 00000100:00100000:2.0:1787432639.279107:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787432639.279114:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:8611:x1874258812768128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432639.279242:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:8611:x1874258812768128:12345-0@lo:502:llog_process_th.0 Request processed in 128us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432639.279249:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787432639.279285:0:8611:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2540 going to sleep for 11 seconds 00000100:00100000:2.0:1787432639.279299:0:8611:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:8611:1874258812768128:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432639.279319:0:8611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432639.279323:0:8611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432639.279325:0:8611:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787432639.279329:0:8611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787432639.279375:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787432639.279391:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432639.279399:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f400/0xbcb9e331c3f0fae9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0faf0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432639.279410:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f400/0xbcb9e331c3f0fae9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0faf0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432639.606102:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432640.629897:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432641.656607:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432641.787203:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812768384:0@lo:400:kworker.0 00000100:00100000:0.0:1787432641.787356:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432641.787415:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812768896:0@lo:400:kworker.0 00000100:00100000:0.0:1787432641.787460:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432641.787494:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787432641.787501:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812768256:0@lo:400:kworker.0 00000100:00100000:0.0:1787432641.787531:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432641.787550:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3333:1874258812768768:0@lo:400:kworker.0 00000100:00100000:0.0:1787432641.787572:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432641.787599:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812768512:0@lo:400:kworker.0 00000100:00100000:0.0:1787432641.787621:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432641.787640:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432641.787654:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812768640:0@lo:400:kworker.0 00000100:00100000:0.0:1787432641.787704:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432641.787738:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812768384 00000100:00100000:0.0:1787432641.787745:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812768384 00000100:00100000:0.0:1787432641.787795:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812768768 00000100:00100000:0.0:1787432641.787798:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812768768 00000100:00100000:0.0:1787432641.787827:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812768512 00000100:00100000:0.0:1787432641.787830:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812768512 00000100:00100000:0.0:1787432641.787849:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787432641.787872:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812768384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432641.787931:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812768384:12345-0@lo:400:kworker.0 Request processed in 73us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432641.787938:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787432641.787975:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787432641.787983:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1874258812768768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432641.788010:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1874258812768768:12345-0@lo:400:kworker.0 Request processed in 29us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432641.788015:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787432641.788028:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787432641.788034:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812768512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432641.788064:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812768512:12345-0@lo:400:kworker.0 Request processed in 30us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432641.788069:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787432641.788088:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812768896 00000100:00100000:0.0:1787432641.788091:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812768896 00000100:00100000:0.0:1787432641.788116:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812768640 00000100:00100000:0.0:1787432641.788119:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812768640 00000100:00100000:0.0:1787432641.788141:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787432641.788156:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812768896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432641.788186:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812768896:12345-0@lo:400:kworker.0 Request processed in 32us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432641.788192:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787432641.788205:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787432641.788210:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812768640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432641.788237:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812768640:12345-0@lo:400:kworker.0 Request processed in 27us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432641.788243:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787432641.788273:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787432641.788277:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787432641.788280:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432641.788325:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3333:1874258812768768:0@lo:400:kworker.0 00000100:00100000:0.0:1787432641.788339:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812768384:0@lo:400:kworker.0 00010000:00080000:0.0:1787432641.788352:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa60700 x1874258812768896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432641.788361:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812768896:0@lo:400:kworker.0 00010000:00080000:0.0:1787432641.788393:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa63800 x1874258812768640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432641.788401:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812768640:0@lo:400:kworker.0 00000100:00100000:0.0:1787432641.788411:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812768512:0@lo:400:kworker.0 00000100:00100000:2.0:1787432641.788758:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812768256 00000100:00100000:2.0:1787432641.788763:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812768256 00000100:00100000:2.0:1787432641.788810:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787432641.788818:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3333:x1874258812768256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432641.788885:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3333:x1874258812768256:12345-0@lo:400:kworker.0 Request processed in 68us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432641.788892:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787432641.789452:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812768256:0@lo:400:kworker.0 00000100:00100000:3.0:1787432642.293991:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432642.294062:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812769024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432642.294135:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432642.294815:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812769024 00000100:00100000:1.0:1787432642.294826:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812769024 00000100:00100000:1.0:1787432642.294887:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787432642.294897:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb992b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812769024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787432642.294931:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432642.294999:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb992b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812769024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432642.295006:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787432642.295047:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa50380 x1874258812769024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432642.295065:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812769024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432642.310595:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432642.310620:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812769152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432642.310752:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432642.310812:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812769152 00000100:00100000:1.0:1787432642.310820:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812769152 00000100:00100000:1.0:1787432642.310863:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787432642.310872:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812769152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432642.310914:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432642.310970:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812769152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432642.310978:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787432642.311030:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa50380 x1874258812769152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432642.311052:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812769152:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787432642.678007:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432643.502061:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432643.502099:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432643.502123:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432643.502145:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432643.502179:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791767168 00000100:00100000:3.0:1787432643.502193:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791767168 00000100:00100000:3.0:1787432643.502275:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791767296 00000100:00100000:3.0:1787432643.502278:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791767296 00000100:00100000:3.0:1787432643.502308:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:3.0:1787432643.502321:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb992b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+5:2376:x1874258791767168:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432643.502408:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb992b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+5:2376:x1874258791767168:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 91us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432643.502416:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:3.0:1787432643.502432:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:3.0:1787432643.502438:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+5:2376:x1874258791767296:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432643.502458:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+5:2376:x1874258791767296:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 21us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432643.502466:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:3.0:1787432643.502481:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791767040 00000100:00100000:3.0:1787432643.502485:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791767040 00000100:00100000:3.0:1787432643.502511:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:3.0:1787432643.502517:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2376:x1874258791767040:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432643.502538:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2376:x1874258791767040:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 22us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432643.502553:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00080000:3.0:1787432643.502570:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432643.502574:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432643.502576:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432643.502704:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791766912 00000100:00100000:3.0:1787432643.502708:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791766912 00000100:00100000:3.0:1787432643.502731:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 194 00000100:00100000:3.0:1787432643.502737:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2376:x1874258791766912:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432643.502764:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2376:x1874258791766912:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 27us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432643.502770:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 194 00010000:00010000:2.0:1787432643.701816:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432644.731770:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787432644.821096:0:8845:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1787432645.750029:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432646.774983:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432646.901963:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812769280:0@lo:400:kworker.0 00000100:00100000:2.0:1787432646.902047:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432646.902116:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812769792:0@lo:400:kworker.0 00000100:00100000:2.0:1787432646.902144:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432646.902172:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787432646.902178:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812769408:0@lo:400:kworker.0 00000100:00100000:2.0:1787432646.902200:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432646.902214:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812769920:0@lo:400:kworker.0 00000100:00100000:2.0:1787432646.902237:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432646.902260:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812769536:0@lo:400:kworker.0 00000100:00100000:2.0:1787432646.902282:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432646.902550:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812769280 00000100:00100000:3.0:1787432646.902570:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812769280 00000100:00100000:3.0:1787432646.902680:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787432646.902695:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812769280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432646.902879:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812769792 00000100:00100000:0.0:1787432646.902885:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812769792 00000100:00100000:0.0:1787432646.902938:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812769408 00000100:00100000:0.0:1787432646.902942:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812769408 00000100:00100000:0.0:1787432646.902965:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812769536 00000100:00100000:0.0:1787432646.902968:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812769536 00000100:00100000:0.0:1787432646.902985:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787432646.902992:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812769792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432646.903584:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787432646.903594:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812769408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432646.903971:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432646.903983:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812769664:0@lo:400:kworker.0 00000100:00100000:3.0:1787432646.908879:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812769280:12345-0@lo:400:kworker.0 Request processed in 5858us (6501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432646.908926:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787432646.908996:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812769920 00000100:00100000:3.0:1787432646.909005:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812769920 00000100:00100000:3.0:1787432646.909057:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787432646.909067:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812769920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432646.909118:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812769920:12345-0@lo:400:kworker.0 Request processed in 53us (6879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432646.909124:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787432646.909145:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432646.909164:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432646.909180:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787432646.909188:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812769536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432646.909224:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812769536:12345-0@lo:400:kworker.0 Request processed in 37us (6940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432646.909230:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787432646.909707:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812769792:12345-0@lo:400:kworker.0 Request processed in 6711us (7557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432646.909715:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1787432646.910166:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbae5b100 x1874258812769920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432646.910183:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812769920:0@lo:400:kworker.0 00000100:00100000:3.0:1787432646.910197:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812769280:0@lo:400:kworker.0 00000100:00100000:3.0:1787432646.910209:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812769792:0@lo:400:kworker.0 00000100:00100000:0.0:1787432646.912330:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812769408:12345-0@lo:400:kworker.0 Request processed in 8728us (10120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432646.912359:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787432646.912797:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812769408:0@lo:400:kworker.0 00000100:00100000:2.0:1787432646.913048:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432646.913127:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812769536:0@lo:400:kworker.0 00000100:00100000:3.0:1787432646.913178:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812769664 00000100:00100000:3.0:1787432646.913185:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812769664 00000100:00100000:3.0:1787432646.913298:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787432646.913309:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812769664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432646.918679:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812769664:12345-0@lo:400:kworker.0 Request processed in 5346us (5605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432646.918695:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787432646.918876:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbae5b480 x1874258812769664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432646.918893:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812769664:0@lo:400:kworker.0 00000100:00080000:0.0:1787432646.920893:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432647.413935:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812770048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432647.414040:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432647.414149:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812770048 00000100:00100000:1.0:1787432647.414160:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812770048 00000100:00100000:1.0:1787432647.414222:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787432647.414233:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812770048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432647.414272:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432647.415256:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812770048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1018us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432647.415270:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787432647.415306:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb992ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812770176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432647.415356:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432647.416865:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812770176 00000100:00100000:1.0:1787432647.416878:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812770176 00000100:00100000:1.0:1787432647.416934:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787432647.416945:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812770176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787432647.416987:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432647.417048:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812770176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432647.417056:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787432647.417103:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb992ad80 x1874258812770176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432647.417206:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb992ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812770176:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787432647.423533:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa50380 x1874258812770048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432647.423566:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812770048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787432647.797810:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432648.626133:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432648.626293:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432648.626555:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791767424 00000100:00100000:3.0:1787432648.626566:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791767424 00000100:00100000:3.0:1787432648.626621:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 196 00000100:00100000:3.0:1787432648.626631:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2378:x1874258791767424:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432648.626728:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2378:x1874258791767424:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 97us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432648.626747:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 196 00000100:00100000:0.0:1787432648.630553:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791767552 00000100:00100000:0.0:1787432648.630569:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791767552 00000100:00080000:3.0:1787432648.630675:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432648.630923:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:0.0:1787432648.630939:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb992ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2378:x1874258791767552:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432648.631016:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb992ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2378:x1874258791767552:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 84us (4723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432648.631031:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:0.0:1787432648.654283:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432648.654329:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432648.656258:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791767680 00000100:00100000:1.0:1787432648.656277:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791767680 00000100:00100000:1.0:1787432648.656361:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791767808 00000100:00100000:1.0:1787432648.656364:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791767808 00000100:00100000:1.0:1787432648.656390:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:1.0:1787432648.656407:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+5:2374:x1874258791767680:12345-192.168.202.15@tcp:9:kworker.0 00000020:00000080:1.0:1787432648.656448:0:6725:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0fa2c 00000100:00080000:1.0:1787432648.656460:0:6725:0:(import.c:65:import_set_state_nolock()) ffff935bbabe7000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787432648.656501:0:6725:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787432648.656916:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+2:2374:x1874258791767680:12345-192.168.202.15@tcp:9:kworker.0 Request processed in 510us (2640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432648.656924:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:1.0:1787432648.656940:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:1.0:1787432648.656946:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+5:2374:x1874258791767808:12345-192.168.202.15@tcp:9:kworker.0 00000020:00000080:1.0:1787432648.656967:0:6725:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0fa33 00000100:00080000:1.0:1787432648.656973:0:6725:0:(import.c:65:import_set_state_nolock()) ffff935bbabe2000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787432648.656995:0:6725:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787432648.657166:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+2:2374:x1874258791767808:12345-192.168.202.15@tcp:9:kworker.0 Request processed in 218us (2835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432648.657173:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00010000:00010000:1.0:1787432648.657250:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432648.657256:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787432648.658245:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787432648.658251:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787432648.821790:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432649.848201:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787432649.961542:0:9090:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing yml_node 00010000:00010000:2.0:1787432650.869792:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787432651.577141:0:6749:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ee8b542c-0113-490f-a721-62606ee0807f 00000020:00000080:2.0:1787432651.577151:0:6749:0:(genops.c:885:class_export_put()) final put ffff935bbabe0800/ee8b542c-0113-490f-a721-62606ee0807f 00000020:00000080:2.0:1787432651.577187:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff935bbabe0800/ee8b542c-0113-490f-a721-62606ee0807f for lustre-OST0000 00000020:00000080:2.0:1787432651.577251:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935bbabe7000 for lustre-OST0000 00010000:00010000:1.0:1787432651.893912:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432652.022990:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812770560:0@lo:400:kworker.0 00000100:00100000:1.0:1787432652.023066:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432652.023153:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432652.023161:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812770688:0@lo:400:kworker.0 00000100:00100000:1.0:1787432652.023189:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432652.023225:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812770560 00000100:00100000:1.0:1787432652.023232:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812770560 00000100:00100000:1.0:1787432652.023290:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787432652.023300:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812770560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432652.023364:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812770560:12345-0@lo:400:kworker.0 Request processed in 65us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432652.023371:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787432652.023405:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812770688 00000100:00100000:1.0:1787432652.023409:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812770688 00000100:00100000:1.0:1787432652.023443:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787432652.023451:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812770688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432652.023482:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812770688:12345-0@lo:400:kworker.0 Request processed in 32us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432652.023500:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787432652.023515:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787432652.023520:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787432652.023552:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa53800 x1874258812770688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432652.023565:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812770688:0@lo:400:kworker.0 00000100:00100000:1.0:1787432652.023576:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812770560:0@lo:400:kworker.0 00000100:00100000:1.0:1787432652.023611:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812770432:0@lo:400:kworker.0 00000100:00100000:1.0:1787432652.023636:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432652.023687:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812770944:0@lo:400:kworker.0 00000100:00100000:1.0:1787432652.023710:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432652.023732:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787432652.023737:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812770304:0@lo:400:kworker.0 00000100:00100000:1.0:1787432652.023765:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432652.023791:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3333:1874258812770816:0@lo:400:kworker.0 00000100:00100000:1.0:1787432652.023814:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432652.023838:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812770432 00000100:00100000:1.0:1787432652.023842:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812770432 00000100:00100000:1.0:1787432652.023880:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812770816 00000100:00100000:1.0:1787432652.023884:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812770816 00000100:00100000:1.0:1787432652.023910:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787432652.023917:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812770432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432652.023953:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812770432:12345-0@lo:400:kworker.0 Request processed in 36us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432652.023960:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787432652.023981:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787432652.023987:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1874258812770816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432652.024018:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1874258812770816:12345-0@lo:400:kworker.0 Request processed in 30us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432652.024024:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787432652.024042:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812770304 00000100:00100000:1.0:1787432652.024045:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812770304 00000100:00100000:1.0:1787432652.024069:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787432652.024076:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3333:x1874258812770304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432652.024104:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3333:x1874258812770304:12345-0@lo:400:kworker.0 Request processed in 29us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432652.024111:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:1.0:1787432652.024136:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432652.024154:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812770304:0@lo:400:kworker.0 00000100:00100000:1.0:1787432652.024163:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3333:1874258812770816:0@lo:400:kworker.0 00000100:00100000:1.0:1787432652.024171:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812770432:0@lo:400:kworker.0 00000100:00100000:2.0:1787432652.024597:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812770944 00000100:00100000:2.0:1787432652.024603:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812770944 00000100:00100000:2.0:1787432652.024651:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787432652.024687:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812770944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432652.024734:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812770944:12345-0@lo:400:kworker.0 Request processed in 51us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432652.024741:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787432652.024774:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa50000 x1874258812770944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432652.024785:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812770944:0@lo:400:kworker.0 00000100:00080000:1.0:1787432652.027467:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1787432652.104329:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ee8b542c-0113-490f-a721-62606ee0807f 00000020:00000080:3.0:1787432652.104337:0:7682:0:(genops.c:885:class_export_put()) final put ffff935bbabe0000/ee8b542c-0113-490f-a721-62606ee0807f 00000020:00000080:1.0:1787432652.106477:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff935bbabe0000/ee8b542c-0113-490f-a721-62606ee0807f for lustre-OST0001 00000020:00000080:1.0:1787432652.106559:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935bbabe2000 for lustre-OST0001 00000100:00100000:2.0:1787432652.534752:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432652.534780:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812771072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432652.534862:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432652.535100:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812771072 00000100:00100000:1.0:1787432652.535108:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812771072 00000100:00100000:1.0:1787432652.535163:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787432652.535173:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812771072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787432652.535212:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432652.535261:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812771072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432652.535281:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787432652.536119:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432652.536133:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812771200:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787432652.536168:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb9929500 x1874258812771072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432652.536176:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432652.536189:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812771072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432652.536260:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812771200 00000100:00100000:3.0:1787432652.536266:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812771200 00000100:00100000:3.0:1787432652.536306:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787432652.536313:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812771200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432652.536336:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787432652.536380:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812771200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432652.536387:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787432652.536995:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa51180 x1874258812771200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432652.537010:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812771200:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787432652.920616:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432653.742074:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432653.742132:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432653.742356:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791768064 00000100:00100000:1.0:1787432653.742367:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791768064 00000100:00100000:0.0:1787432653.742399:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791767936 00000100:00100000:0.0:1787432653.742405:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791767936 00000100:00100000:0.0:1787432653.742445:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 198 00000100:00100000:1.0:1787432653.742454:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:1.0:1787432653.742467:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb992bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+6:2378:x1874258791768064:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432653.742470:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2378:x1874258791767936:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432653.742546:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2378:x1874258791767936:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 81us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432653.742554:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 198 00000100:00080000:2.0:1787432653.742559:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432653.746193:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb992bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+6:2378:x1874258791768064:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 3711us (4042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432653.746212:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 45 00010000:00010000:1.0:1787432653.941937:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432654.965888:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787432655.195493:0:9286:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.63 00010000:00010000:1.0:1787432655.991099:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432657.013766:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432657.142561:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812771584:0@lo:400:kworker.0 00000100:00100000:3.0:1787432657.142822:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432657.142938:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812771584 00000100:00100000:3.0:1787432657.142949:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812771584 00000100:00100000:3.0:1787432657.143026:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787432657.143038:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812771584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432657.143107:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812771584:12345-0@lo:400:kworker.0 Request processed in 72us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432657.143116:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1787432657.143145:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432657.143186:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812771584:0@lo:400:kworker.0 00000100:00100000:3.0:1787432657.143230:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812771712:0@lo:400:kworker.0 00000100:00100000:3.0:1787432657.143279:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432657.143313:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812771712 00000100:00100000:3.0:1787432657.143317:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812771712 00000100:00100000:3.0:1787432657.143350:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787432657.143357:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812771712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432657.143390:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812771712:12345-0@lo:400:kworker.0 Request processed in 34us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432657.143397:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787432657.143412:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787432657.143429:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb9527b80 x1874258812771712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432657.143441:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812771712:0@lo:400:kworker.0 00000100:00100000:1.0:1787432657.143549:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812771328:0@lo:400:kworker.0 00000100:00100000:1.0:1787432657.143594:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432657.143635:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812771840:0@lo:400:kworker.0 00000100:00100000:1.0:1787432657.143695:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432657.143795:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787432657.143813:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812771456:0@lo:400:kworker.0 00000100:00100000:1.0:1787432657.143842:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432657.143859:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812771968:0@lo:400:kworker.0 00000100:00100000:1.0:1787432657.143886:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432657.143919:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812771840 00000100:00100000:1.0:1787432657.143924:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812771840 00000100:00100000:1.0:1787432657.143961:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812771456 00000100:00100000:1.0:1787432657.143965:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812771456 00000100:00100000:1.0:1787432657.143984:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787432657.143991:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812771840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432657.144032:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812771840:12345-0@lo:400:kworker.0 Request processed in 41us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432657.144048:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787432657.144067:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787432657.144073:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812771456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432657.144102:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812771456:12345-0@lo:400:kworker.0 Request processed in 30us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432657.144108:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787432657.144128:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812771968 00000100:00100000:1.0:1787432657.144132:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812771968 00000100:00100000:1.0:1787432657.144162:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787432657.144169:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812771968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432657.144199:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812771968:12345-0@lo:400:kworker.0 Request processed in 30us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432657.144205:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787432657.144240:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812771456:0@lo:400:kworker.0 00010000:00080000:1.0:1787432657.144251:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb9524e00 x1874258812771968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432657.144260:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812771968:0@lo:400:kworker.0 00000100:00100000:1.0:1787432657.144268:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812771840:0@lo:400:kworker.0 00000100:00100000:3.0:1787432657.146905:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812771328 00000100:00100000:3.0:1787432657.146930:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812771328 00000100:00100000:3.0:1787432657.147010:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787432657.147022:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812771328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432657.147164:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812771328:12345-0@lo:400:kworker.0 Request processed in 143us (3567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432657.147173:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:3.0:1787432657.147225:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432657.147233:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432657.147275:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812771328:0@lo:400:kworker.0 00000100:00100000:2.0:1787432657.653862:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432657.653895:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812772096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432657.654188:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432657.654281:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812772096 00000100:00100000:2.0:1787432657.654291:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812772096 00000100:00100000:2.0:1787432657.654348:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787432657.654358:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812772096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432657.654402:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432657.654451:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812772096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432657.654459:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787432657.654504:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbae59180 x1874258812772096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432673 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432657.654524:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812772096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432657.656684:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432657.656710:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812772224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432657.656796:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432657.656888:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812772224 00000100:00100000:1.0:1787432657.656899:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812772224 00000100:00100000:1.0:1787432657.656959:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787432657.656981:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812772224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432657.657034:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432657.657094:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812772224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432657.657102:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1787432657.660698:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa50000 x1874258812772224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432673 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432657.660741:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812772224:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787432657.758518:0:9383:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.63 00010000:00010000:3.0:1787432658.039748:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432658.865742:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432658.865816:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432658.865851:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791768192 00000100:00100000:0.0:1787432658.865874:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791768192 00000100:00100000:0.0:1787432658.865948:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 200 00000100:00100000:0.0:1787432658.865960:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2377:x1874258791768192:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432658.866073:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2377:x1874258791768192:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 114us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432658.866082:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 200 00000100:00100000:2.0:1787432658.866875:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791768320 00000100:00100000:2.0:1787432658.866887:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791768320 00000100:00100000:2.0:1787432658.866962:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:2.0:1787432658.866972:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2377:x1874258791768320:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787432658.867043:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2377:x1874258791768320:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 73us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432658.867051:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00080000:0.0:1787432658.867387:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787432659.061905:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432660.086856:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787432660.104562:0:9480:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.63 00010000:00010000:2.0:1787432661.110804:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787432661.704914:0:9529:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Aug 22 17:04:20 EDT 2026 00010000:00010000:0.0:1787432662.134031:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432662.266857:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812772352:0@lo:400:kworker.0 00000100:00100000:2.0:1787432662.266940:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432662.267017:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812772352 00000100:00100000:2.0:1787432662.267024:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812772352 00000100:00100000:2.0:1787432662.267066:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787432662.267074:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812772352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432662.267118:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812772352:12345-0@lo:400:kworker.0 Request processed in 45us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432662.267125:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787432662.267965:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812772864:0@lo:400:kworker.0 00000100:00100000:2.0:1787432662.268006:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432662.268052:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812772352:0@lo:400:kworker.0 00000100:00100000:2.0:1787432662.268073:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787432662.268080:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812772480:0@lo:400:kworker.0 00000100:00100000:2.0:1787432662.268103:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432662.268154:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812772864 00000100:00100000:2.0:1787432662.268158:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812772864 00000100:00100000:2.0:1787432662.268199:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812772480 00000100:00100000:2.0:1787432662.268202:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812772480 00000100:00100000:2.0:1787432662.268221:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787432662.268228:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812772864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432662.269974:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787432662.269999:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812772480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432662.274773:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812772992:0@lo:400:kworker.0 00000100:00100000:3.0:1787432662.276643:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812772480:12345-0@lo:400:kworker.0 Request processed in 6644us (8526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432662.276706:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787432662.277823:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432662.278995:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812772608:0@lo:400:kworker.0 00000100:00100000:3.0:1787432662.279083:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432662.279137:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432662.279147:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812772736:0@lo:400:kworker.0 00000100:00100000:3.0:1787432662.279177:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432662.279219:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812772608 00000100:00100000:3.0:1787432662.279230:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812772608 00000100:00100000:3.0:1787432662.279294:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787432662.279305:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812772608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432662.279366:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812772608:12345-0@lo:400:kworker.0 Request processed in 63us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432662.279374:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787432662.279397:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812772736 00000100:00100000:3.0:1787432662.279402:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812772736 00000100:00100000:2.0:1787432662.279850:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812772864:12345-0@lo:400:kworker.0 Request processed in 11620us (11840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432662.279860:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1787432662.280006:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787432662.280011:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432662.280048:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812772608:0@lo:400:kworker.0 00000100:00100000:1.0:1787432662.280383:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812772480:0@lo:400:kworker.0 00000100:00100000:1.0:1787432662.280397:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812772864:0@lo:400:kworker.0 00000100:00100000:1.0:1787432662.280457:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432662.280625:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812772992 00000100:00100000:3.0:1787432662.280631:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812772992 00000100:00100000:1.0:1787432662.286111:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787432662.286146:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812772736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432662.286300:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812772736:12345-0@lo:400:kworker.0 Request processed in 173us (7121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432662.286308:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787432662.286339:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787432662.286348:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812772992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432662.286390:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812772992:12345-0@lo:400:kworker.0 Request processed in 43us (5947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432662.286396:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787432662.286707:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935a84b45880 x1874258812772736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432662.286744:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812772736:0@lo:400:kworker.0 00010000:00080000:1.0:1787432662.286909:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935a84b44380 x1874258812772992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432662.286920:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812772992:0@lo:400:kworker.0 00000100:00080000:1.0:1787432662.286977:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432662.778222:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787432662.778268:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812773120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432662.778398:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432662.779134:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812773120 00000100:00100000:0.0:1787432662.779149:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812773120 00000100:00100000:0.0:1787432662.779217:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787432662.779230:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812773120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432662.779292:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787432662.779382:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812773120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432662.779391:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1787432662.780436:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935a84b44380 x1874258812773120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432662.780472:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812773120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432662.782387:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432662.787573:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812773248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432662.787764:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432662.788281:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812773248 00000100:00100000:0.0:1787432662.788294:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812773248 00000100:00100000:0.0:1787432662.788377:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787432662.788392:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812773248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787432662.788454:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787432662.788778:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812773248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 388us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432662.788787:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787432662.790127:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935a84b45180 x1874258812773248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432662.790166:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812773248:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787432663.159872:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432663.986085:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432663.986173:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432663.986359:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791768576 00000100:00100000:2.0:1787432663.986373:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791768576 00000100:00100000:2.0:1787432663.986470:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:2.0:1787432663.986483:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791768576:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787432663.986591:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791768576:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 111us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432663.986601:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:1.0:1787432663.986800:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791768448 00000100:00100000:1.0:1787432663.986806:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791768448 00000100:00100000:1.0:1787432663.986843:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 202 00000100:00100000:1.0:1787432663.986850:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2375:x1874258791768448:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432663.987052:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2375:x1874258791768448:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 201us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432663.987059:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 202 00000100:00080000:3.0:1787432663.987946:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787432664.183431:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432665.205810:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432666.232080:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432667.255885:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432667.384248:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812773376:0@lo:400:kworker.0 00000100:00100000:1.0:1787432667.384399:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432667.384519:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812773888:0@lo:400:kworker.0 00000100:00100000:1.0:1787432667.384554:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432667.384593:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787432667.384599:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812773504:0@lo:400:kworker.0 00000100:00100000:1.0:1787432667.384687:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432667.384719:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812774016:0@lo:400:kworker.0 00000100:00100000:1.0:1787432667.384751:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432667.384807:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812773888 00000100:00100000:1.0:1787432667.384817:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812773888 00000100:00100000:1.0:1787432667.384891:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812773504 00000100:00100000:1.0:1787432667.384895:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812773504 00000100:00100000:1.0:1787432667.384921:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787432667.384932:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812773888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432667.384997:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812773888:12345-0@lo:400:kworker.0 Request processed in 66us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432667.385005:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787432667.385044:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787432667.385051:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812773504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432667.385079:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812773504:12345-0@lo:400:kworker.0 Request processed in 29us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432667.385085:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787432667.385110:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812774016 00000100:00100000:1.0:1787432667.385113:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812774016 00000100:00100000:1.0:1787432667.385145:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787432667.385152:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812774016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432667.385185:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812774016:12345-0@lo:400:kworker.0 Request processed in 34us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432667.385192:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787432667.385212:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432667.385219:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432667.385264:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812773504:0@lo:400:kworker.0 00010000:00080000:1.0:1787432667.385294:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbae5a680 x1874258812774016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432667.385306:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812774016:0@lo:400:kworker.0 00000100:00100000:1.0:1787432667.385315:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812773888:0@lo:400:kworker.0 00000100:00100000:3.0:1787432667.385810:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812773632:0@lo:400:kworker.0 00000100:00100000:3.0:1787432667.385852:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432667.385884:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432667.385891:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812773760:0@lo:400:kworker.0 00000100:00100000:3.0:1787432667.385914:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432667.385977:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812773632 00000100:00100000:3.0:1787432667.385981:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812773632 00000100:00100000:3.0:1787432667.386028:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787432667.386035:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812773632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432667.386080:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812773632:12345-0@lo:400:kworker.0 Request processed in 45us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432667.386087:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787432667.386121:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812773760 00000100:00100000:3.0:1787432667.386125:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812773760 00000100:00100000:3.0:1787432667.386152:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787432667.386158:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9557800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812773760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432667.386192:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9557800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812773760:12345-0@lo:400:kworker.0 Request processed in 34us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432667.386198:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787432667.386230:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbae5a300 x1874258812773760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432667.386244:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812773760:0@lo:400:kworker.0 00000100:00100000:3.0:1787432667.386256:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812773632:0@lo:400:kworker.0 00000100:00080000:1.0:1787432667.391477:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787432667.391491:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432667.394909:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812773376 00000100:00100000:2.0:1787432667.394930:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812773376 00000100:00100000:2.0:1787432667.395505:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787432667.395519:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812773376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432667.395721:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812773376:12345-0@lo:400:kworker.0 Request processed in 196us (11313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432667.395730:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787432667.399005:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812773376:0@lo:400:kworker.0 00000100:00100000:2.0:1787432667.894083:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812774144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432667.894351:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432667.894618:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812774144 00000100:00100000:1.0:1787432667.894632:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812774144 00000100:00100000:1.0:1787432667.894745:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787432667.894757:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812774144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432667.894816:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432667.894886:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812774144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432667.894897:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787432667.895045:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb9554380 x1874258812774144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432667.895076:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812774144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432667.895133:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb6e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812774272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432667.895206:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432667.895571:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812774272 00000100:00100000:1.0:1787432667.895580:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812774272 00000100:00100000:1.0:1787432667.895626:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787432667.895637:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812774272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787432667.895698:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432667.895757:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812774272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432667.895765:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787432667.895804:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbb6e1500 x1874258812774272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432667.895819:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb6e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812774272:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787432668.277991:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432669.101854:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432669.101955:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432669.102275:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791768832 00000100:00100000:2.0:1787432669.102287:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791768832 00000100:00100000:2.0:1787432669.102423:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:2.0:1787432669.102435:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+6:2378:x1874258791768832:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787432669.102513:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+6:2378:x1874258791768832:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 81us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432669.102520:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00080000:3.0:1787432669.103034:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432669.108756:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791768704 00000100:00100000:1.0:1787432669.108773:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791768704 00000100:00100000:1.0:1787432669.108845:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 204 00000100:00100000:1.0:1787432669.108856:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2378:x1874258791768704:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432669.108943:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2378:x1874258791768704:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 88us (7095us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432669.108951:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 204 00010000:00010000:2.0:1787432669.302073:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432670.326871:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432671.350199:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432672.375824:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432672.506258:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812774400:0@lo:400:kworker.0 00000100:00100000:0.0:1787432672.506258:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812774528:0@lo:400:kworker.0 00000100:00100000:3.0:1787432672.506372:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432672.506420:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812774912:0@lo:400:kworker.0 00000100:00100000:3.0:1787432672.506445:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432672.506557:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812774400 00000100:00100000:3.0:1787432672.506564:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812774400 00000100:00100000:3.0:1787432672.506609:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787432672.507739:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432672.507773:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812775040:0@lo:400:kworker.0 00000100:00100000:0.0:1787432672.507805:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432672.507846:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812774656:0@lo:400:kworker.0 00000100:00100000:0.0:1787432672.507872:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432672.507892:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432672.507899:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812774784:0@lo:400:kworker.0 00000100:00100000:0.0:1787432672.507921:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432672.507952:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812774912 00000100:00100000:0.0:1787432672.507957:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812774912 00000100:00100000:0.0:1787432672.508001:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812774528 00000100:00100000:0.0:1787432672.508004:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812774528 00000100:00100000:0.0:1787432672.508021:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812774656 00000100:00100000:0.0:1787432672.508024:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812774656 00000100:00100000:0.0:1787432672.508807:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787432672.508821:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812774912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432672.508881:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812774912:12345-0@lo:400:kworker.0 Request processed in 63us (2434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432672.508889:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787432672.508907:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787432672.508913:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812774528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432672.509730:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812774528:12345-0@lo:400:kworker.0 Request processed in 814us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432672.509739:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787432672.509758:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787432672.509774:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812774656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432672.509818:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812774656:12345-0@lo:400:kworker.0 Request processed in 46us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432672.509824:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787432672.509846:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812775040 00000100:00100000:0.0:1787432672.509852:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812775040 00000100:00100000:0.0:1787432672.509884:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812774784 00000100:00100000:0.0:1787432672.509887:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812774784 00000100:00100000:0.0:1787432672.509907:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787432672.509914:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812775040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432672.509945:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812775040:12345-0@lo:400:kworker.0 Request processed in 32us (2140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432672.509951:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787432672.509962:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787432672.509968:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812774784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432672.509993:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812774784:12345-0@lo:400:kworker.0 Request processed in 26us (2071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432672.509998:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1787432672.510022:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787432672.510026:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787432672.510029:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787432672.510713:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbabbf800 x1874258812774784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432672.510729:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812774784:0@lo:400:kworker.0 00000100:00100000:0.0:1787432672.510745:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812774656:0@lo:400:kworker.0 00000100:00100000:3.0:1787432672.511316:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812774400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432672.511372:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812774400:12345-0@lo:400:kworker.0 Request processed in 65us (5000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432672.511379:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787432672.511435:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812774400:0@lo:400:kworker.0 00000100:00100000:3.0:1787432672.511449:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812774912:0@lo:400:kworker.0 00000100:00100000:1.0:1787432672.519259:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812774528:0@lo:400:kworker.0 00010000:00080000:0.0:1787432672.519364:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbabbc000 x1874258812775040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432672.519394:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812775040:0@lo:400:kworker.0 00000100:00100000:2.0:1787432673.014136:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432673.014168:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812775168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432673.014258:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432673.014367:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812775168 00000100:00100000:2.0:1787432673.014374:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812775168 00000100:00100000:1.0:1787432673.014396:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432673.014408:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812775296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432673.014434:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787432673.014437:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432673.014443:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812775168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432673.014478:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787432673.014494:0:6727:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1787432673.014504:0:6727:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1787432673.014531:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812775168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432673.014538:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787432673.014555:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812775296 00000100:00100000:2.0:1787432673.014558:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812775296 00000100:00100000:2.0:1787432673.014583:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787432673.014590:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812775296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432673.014608:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432673.014645:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812775296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432673.014651:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787432673.014712:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb9555f80 x1874258812775168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432689 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432673.014747:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812775168:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787432673.014767:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa63800 x1874258812775296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432689 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432673.014780:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812775296:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787432673.399852:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432674.223743:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432674.223800:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432674.223831:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791768960 00000100:00100000:0.0:1787432674.223842:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791768960 00000100:00100000:0.0:1787432674.223904:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 206 00000100:00100000:0.0:1787432674.223917:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2377:x1874258791768960:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432674.223988:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2377:x1874258791768960:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 74us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432674.223995:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 206 00000100:00100000:2.0:1787432674.224209:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791769088 00000100:00100000:2.0:1787432674.224213:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791769088 00000100:00100000:2.0:1787432674.224267:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:2.0:1787432674.224275:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:2377:x1874258791769088:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787432674.224312:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:2377:x1874258791769088:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 39us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432674.224318:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00080000:0.0:1787432674.225597:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787432674.427393:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432675.446412:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432676.470029:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432677.493821:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432677.622123:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb6e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812775808:0@lo:400:kworker.0 00000100:00100000:1.0:1787432677.622192:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432677.622286:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787432677.622293:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb6e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3331:1874258812775680:0@lo:400:kworker.0 00000100:00100000:1.0:1787432677.622320:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432677.622432:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb6e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812775424:0@lo:400:kworker.0 00000100:00100000:0.0:1787432677.622485:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb6e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812775552:0@lo:400:kworker.0 00000100:00100000:3.0:1787432677.623404:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812775808 00000100:00100000:3.0:1787432677.623413:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812775808 00000100:00100000:3.0:1787432677.623478:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787432677.623488:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812775808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432677.623789:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432677.623833:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb6e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812775936:0@lo:400:kworker.0 00000100:00100000:2.0:1787432677.623863:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432677.623902:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812775424 00000100:00100000:2.0:1787432677.623905:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812775424 00000100:00100000:2.0:1787432677.623935:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787432677.623941:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812775424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432677.623974:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812775424:12345-0@lo:400:kworker.0 Request processed in 33us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432677.623980:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787432677.624010:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812775680 00000100:00100000:2.0:1787432677.624013:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812775680 00000100:00100000:2.0:1787432677.624035:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812775936 00000100:00100000:2.0:1787432677.624051:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812775936 00000100:00100000:2.0:1787432677.624076:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787432677.624081:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3331:x1874258812775680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432677.624108:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3331:x1874258812775680:12345-0@lo:400:kworker.0 Request processed in 27us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432677.624113:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787432677.624124:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787432677.624129:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812775936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432677.624151:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812775936:12345-0@lo:400:kworker.0 Request processed in 22us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432677.624157:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787432677.624198:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb6e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812775424:0@lo:400:kworker.0 00000100:00100000:2.0:1787432677.624721:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb6e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812775936:0@lo:400:kworker.0 00000100:00080000:2.0:1787432677.624772:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787432677.624777:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432677.625717:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432677.625764:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb6e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812776064:0@lo:400:kworker.0 00000100:00100000:0.0:1787432677.625796:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432677.625833:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812776064 00000100:00100000:0.0:1787432677.625839:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812776064 00000100:00100000:0.0:1787432677.625887:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787432677.625908:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812776064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432677.625955:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812776064:12345-0@lo:400:kworker.0 Request processed in 49us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432677.625961:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1787432677.625981:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787432677.626015:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbb6e3800 x1874258812776064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432677.626026:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb6e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812776064:0@lo:400:kworker.0 00000100:00100000:2.0:1787432677.626170:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812775552 00000100:00100000:2.0:1787432677.626176:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812775552 00000100:00100000:2.0:1787432677.626204:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787432677.626504:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812775552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432677.626564:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812775552:12345-0@lo:400:kworker.0 Request processed in 61us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432677.626907:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb6e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3331:1874258812775680:0@lo:400:kworker.0 00000100:00100000:1.0:1787432677.626953:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb6e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812775552:0@lo:400:kworker.0 00000100:00100000:2.0:1787432677.627393:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787432677.627701:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812775808:12345-0@lo:400:kworker.0 Request processed in 4213us (5506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432677.627709:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1787432677.627781:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbb6e1180 x1874258812775808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432677.627792:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb6e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812775808:0@lo:400:kworker.0 00000100:00100000:1.0:1787432678.134168:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787432678.134197:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812776192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432678.134315:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432678.134456:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812776192 00000100:00100000:3.0:1787432678.134472:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812776192 00000100:00100000:3.0:1787432678.134557:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787432678.134569:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812776192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432678.134619:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787432678.134702:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812776192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432678.134709:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787432678.135267:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb9554700 x1874258812776192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432694 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432678.135289:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812776192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432678.139052:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb6e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812776320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432678.139134:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432678.139647:0:9985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812776320 00000100:00100000:2.0:1787432678.139676:0:9985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812776320 00000100:00100000:2.0:1787432678.139743:0:9985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787432678.139755:0:9985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812776320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432678.139815:0:9985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432678.141093:0:9985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812776320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1336us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432678.141104:0:9985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1787432678.163005:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbb6e1c00 x1874258812776320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432694 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432678.163036:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb6e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812776320:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787432678.517969:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787432678.585413:0:10161:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 17:04:37 (1787432677) === 00000100:00100000:3.0:1787432679.258174:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432679.259433:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791769216 00000100:00100000:1.0:1787432679.259447:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791769216 00000100:00100000:1.0:1787432679.259526:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 208 00000100:00100000:1.0:1787432679.259537:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87907850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:8161:x1874258791769216:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787432679.259566:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432679.259587:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba416000/0xbcb9e331c3f0faf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a025b2e expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432679.259629:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba416000/0xbcb9e331c3f0faf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b2e expref: 11 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432679.259639:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba416000/0xbcb9e331c3f0faf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b2e expref: 11 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432679.259649:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba416000, rc 0) 00000100:00100000:1.0:1787432679.259753:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87907850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+11:8161:x1874258791769216:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 217us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432679.259760:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 208 00000100:00100000:0.0:1787432679.271453:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432679.271870:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791769344 00000100:00100000:2.0:1787432679.271882:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791769344 00000100:00100000:2.0:1787432679.271957:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 209 00000100:00100000:2.0:1787432679.271968:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+11:8161:x1874258791769344:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787432679.272328:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+11:8161:x1874258791769344:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 360us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432679.272337:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 209 00000100:00100000:3.0:1787432679.283033:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432679.288613:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791769472 00000100:00100000:1.0:1787432679.288631:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791769472 00000100:00100000:1.0:1787432679.288734:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 210 00000100:00100000:1.0:1787432679.288744:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+11:8161:x1874258791769472:12345-192.168.202.15@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787432679.289051:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+11:8161:x1874258791769472:12345-192.168.202.15@tcp:503:mount.lustre.0 Request processed in 307us (6029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432679.289060:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 210 00000100:00100000:0.0:1787432679.294878:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432679.299195:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791769600 00000100:00100000:3.0:1787432679.299224:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791769600 00000100:00100000:3.0:1787432679.299338:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 211 00000100:00100000:3.0:1787432679.299352:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87904450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+11:8165:x1874258791769600:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787432679.299895:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87904450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+11:8165:x1874258791769600:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 542us (5030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432679.299906:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 211 00000100:00100000:0.0:1787432679.320263:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432679.320414:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791769728 00000100:00100000:2.0:1787432679.320430:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791769728 00000100:00100000:2.0:1787432679.320508:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 212 00000100:00100000:2.0:1787432679.320531:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+11:8165:x1874258791769728:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787432679.320983:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+11:8165:x1874258791769728:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 454us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432679.320994:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 212 00000100:00100000:0.0:1787432679.324494:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432679.324784:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791769856 00000100:00100000:1.0:1787432679.324797:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791769856 00000100:00100000:1.0:1787432679.324874:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 213 00000100:00100000:1.0:1787432679.324888:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87906c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+11:8161:x1874258791769856:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787432679.324912:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432679.324937:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba416600/0xbcb9e331c3f0fafe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a025b58 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432679.324975:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba416600/0xbcb9e331c3f0fafe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b58 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432679.324988:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba416600/0xbcb9e331c3f0fafe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b58 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432679.325000:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba416600, rc 0) 00000100:00100000:1.0:1787432679.325076:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87906c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:8161:x1874258791769856:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 191us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432679.325084:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 213 00000100:00100000:0.0:1787432679.335372:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432679.335487:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791769984 00000100:00100000:3.0:1787432679.335501:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791769984 00000100:00100000:3.0:1787432679.335583:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 214 00000100:00100000:3.0:1787432679.335614:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:8161:x1874258791769984:12345-192.168.202.15@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787432679.335701:0:5861:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787432679.335736:0:5861:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787432679.335740:0:5861:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787432679.335744:0:5861:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787432679.335747:0:5861:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787432679.343175:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432679.343271:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791770112 00000100:00100000:2.0:1787432679.343284:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791770112 00000100:00100000:2.0:1787432679.343384:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 65 00000100:00100000:2.0:1787432679.343397:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2376:x1874258791770112:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787432679.343520:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2376:x1874258791770112:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 114us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432679.343530:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 65 00000100:00080000:0.0:1787432679.344350:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432679.348080:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:8161:x1874258791769984:12345-192.168.202.15@tcp:256:mount.lustre.0 Request processed in 12464us (12703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432679.348118:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 214 00000100:00100000:1.0:1787432679.353123:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432679.353260:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791770240 00000100:00100000:2.0:1787432679.353273:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791770240 00000100:00100000:2.0:1787432679.353349:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 215 00000100:00100000:2.0:1787432679.353361:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:8161:x1874258791770240:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787432679.353386:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432679.353412:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bbaa5f000/0xbcb9e331c3f0fb05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a025b5f expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432679.353451:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bbaa5f000/0xbcb9e331c3f0fb05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b5f expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432679.353464:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bbaa5f000/0xbcb9e331c3f0fb05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b5f expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432679.353476:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f000, rc 0) 00000100:00100000:2.0:1787432679.353592:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:8161:x1874258791770240:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 225us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432679.353615:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 215 00000100:00100000:0.0:1787432679.356187:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432679.356281:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791770368 00000100:00100000:3.0:1787432679.356292:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791770368 00000100:00100000:3.0:1787432679.356358:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 216 00000100:00100000:3.0:1787432679.356369:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87905c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:8161:x1874258791770368:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787432679.356880:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87905c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:8161:x1874258791770368:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 509us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432679.356891:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 216 00000100:00100000:0.0:1787432679.360141:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432679.361008:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791770496 00000100:00100000:1.0:1787432679.361025:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791770496 00000100:00100000:1.0:1787432679.361107:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 217 00000100:00100000:1.0:1787432679.361119:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87904050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:8161:x1874258791770496:12345-192.168.202.15@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787432679.361465:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87904050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:8161:x1874258791770496:12345-192.168.202.15@tcp:503:mount.lustre.0 Request processed in 347us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432679.361482:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 217 00000100:00100000:1.0:1787432679.364471:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432679.364611:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791770624 00000100:00100000:2.0:1787432679.364625:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791770624 00000100:00100000:2.0:1787432679.364724:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 218 00000100:00100000:2.0:1787432679.364736:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87905850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:8169:x1874258791770624:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787432679.365095:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87905850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:8169:x1874258791770624:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 360us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432679.365105:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 218 00000100:00100000:0.0:1787432679.376494:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432679.376770:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791770752 00000100:00100000:3.0:1787432679.376787:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791770752 00000100:00100000:3.0:1787432679.376872:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 219 00000100:00100000:3.0:1787432679.376884:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:8169:x1874258791770752:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787432679.377220:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:8169:x1874258791770752:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 337us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432679.377229:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 219 00000100:00100000:0.0:1787432679.385426:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432679.385556:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791770880 00000100:00100000:2.0:1787432679.385570:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791770880 00000100:00100000:2.0:1787432679.385704:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:2.0:1787432679.385716:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2374:x1874258791770880:12345-192.168.202.15@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787432679.385761:0:5867:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5c1bafcc-88f0-4bc2-9523-0dc619fa83f5@192.168.202.15@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:2.0:1787432679.385813:0:5867:0:(genops.c:1385:class_connect()) connect: client 5c1bafcc-88f0-4bc2-9523-0dc619fa83f5, cookie 0xbcb9e331c3f0fb0c 00000004:00100000:2.0:1787432679.385856:0:5867:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787432679.386208:0:5867:0:(import.c:65:import_set_state_nolock()) ffff935bbb47b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432679.386317:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:2374:x1874258791770880:12345-192.168.202.15@tcp:38:mount.lustre.0 Request processed in 601us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432679.386326:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:1.0:1787432679.392082:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432679.392208:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791771008 00000100:00100000:2.0:1787432679.392221:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791771008 00000100:00080000:0.0:1787432679.392385:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432679.392453:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:2.0:1787432679.392468:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:0:x1874258791771008:12345-192.168.202.15@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787432679.392550:0:5869:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787432679.396035:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:0:x1874258791771008:12345-192.168.202.15@tcp:41:mount.lustre.0 Request processed in 3558us (3956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432679.396049:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:1.0:1787432679.400050:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432679.400188:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791771136 00000100:00100000:3.0:1787432679.400203:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791771136 00000100:00100000:3.0:1787432679.400290:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:3.0:1787432679.400304:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:8161:x1874258791771136:12345-192.168.202.15@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787432679.400347:0:6929:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787432679.400448:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:8161:x1874258791771136:12345-192.168.202.15@tcp:41:mount.lustre.0 Request processed in 147us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432679.400456:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:0.0:1787432679.402652:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432679.402778:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791771264 00000100:00100000:2.0:1787432679.402793:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791771264 00000100:00100000:2.0:1787432679.402865:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:2.0:1787432679.402876:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:8161:x1874258791771264:12345-192.168.202.15@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787432679.402984:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:8161:x1874258791771264:12345-192.168.202.15@tcp:40:mount.lustre.0 Request processed in 108us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432679.402991:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:1.0:1787432679.405383:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432679.405443:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432679.405480:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432679.405722:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791771648 00000100:00100000:2.0:1787432679.405752:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791771648 00000100:00100000:3.0:1787432679.405878:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791771392 00000100:00100000:3.0:1787432679.405890:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791771392 00000100:00100000:3.0:1787432679.405920:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791771520 00000100:00100000:3.0:1787432679.405922:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791771520 00000100:00100000:3.0:1787432679.405945:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:3.0:1787432679.405956:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2374:x1874258791771392:12345-192.168.202.15@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787432679.406006:0:6725:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5c1bafcc-88f0-4bc2-9523-0dc619fa83f5@192.168.202.15@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:3.0:1787432679.406052:0:6725:0:(genops.c:1385:class_connect()) connect: client 5c1bafcc-88f0-4bc2-9523-0dc619fa83f5, cookie 0xbcb9e331c3f0fb13 00002000:00100000:3.0:1787432679.406073:0:6725:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5c1bafcc-88f0-4bc2-9523-0dc619fa83f5/ffff935b8752d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787432679.406106:0:6725:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787432679.406417:0:6725:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787432679.406461:0:6725:0:(import.c:65:import_set_state_nolock()) ffff935b87528000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787432679.406591:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:2374:x1874258791771392:12345-192.168.202.15@tcp:8:mount.lustre.0 Request processed in 626us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432679.406611:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:3.0:1787432679.406636:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:3.0:1787432679.406642:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2374:x1874258791771520:12345-192.168.202.15@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787432679.406697:0:6725:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5c1bafcc-88f0-4bc2-9523-0dc619fa83f5@192.168.202.15@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:3.0:1787432679.406719:0:6725:0:(genops.c:1385:class_connect()) connect: client 5c1bafcc-88f0-4bc2-9523-0dc619fa83f5, cookie 0xbcb9e331c3f0fb1a 00002000:00100000:3.0:1787432679.406726:0:6725:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5c1bafcc-88f0-4bc2-9523-0dc619fa83f5/ffff935b8752a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787432679.406745:0:6725:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787432679.406888:0:6725:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787432679.406905:0:6725:0:(import.c:65:import_set_state_nolock()) ffff935b8752c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787432679.406930:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:2374:x1874258791771520:12345-192.168.202.15@tcp:8:mount.lustre.0 Request processed in 287us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432679.406937:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:1.0:1787432679.409080:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:1.0:1787432679.409111:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:8161:x1874258791771648:12345-192.168.202.15@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787432679.409505:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787432679.410306:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:8161:x1874258791771648:12345-192.168.202.15@tcp:33:mount.lustre.0 Request processed in 1206us (4935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432679.410318:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 1 00010000:00010000:2.0:1787432679.541888:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432680.566254:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432681.591829:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787432682.305912:0:6749:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5c1bafcc-88f0-4bc2-9523-0dc619fa83f5 00010000:00010000:2.0:1787432682.617943:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432682.746020:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812776448:0@lo:400:kworker.0 00000100:00100000:2.0:1787432682.746132:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432682.746196:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812776960:0@lo:400:kworker.0 00000100:00100000:2.0:1787432682.746228:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432682.746264:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787432682.746269:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812776576:0@lo:400:kworker.0 00000100:00100000:2.0:1787432682.746316:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432682.746337:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812777088:0@lo:400:kworker.0 00000100:00100000:2.0:1787432682.746366:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432682.746401:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812776704:0@lo:400:kworker.0 00000100:00100000:2.0:1787432682.746426:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432682.746447:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432682.746452:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812776832:0@lo:400:kworker.0 00000100:00100000:2.0:1787432682.746475:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432682.746517:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812776448 00000100:00100000:2.0:1787432682.746527:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812776448 00000100:00100000:2.0:1787432682.746595:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787432682.746607:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812776448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432682.746695:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812776448:12345-0@lo:400:kworker.0 Request processed in 89us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432682.746703:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787432682.746741:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812776960 00000100:00100000:2.0:1787432682.746744:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812776960 00000100:00100000:2.0:1787432682.746792:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812776576 00000100:00100000:2.0:1787432682.746795:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812776576 00000100:00100000:2.0:1787432682.746811:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812776704 00000100:00100000:2.0:1787432682.746813:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812776704 00000100:00100000:2.0:1787432682.746830:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787432682.746836:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812776960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432682.746873:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812776960:12345-0@lo:400:kworker.0 Request processed in 37us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432682.746880:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787432682.746892:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787432682.746898:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812776576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432682.746927:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812776576:12345-0@lo:400:kworker.0 Request processed in 29us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432682.746933:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787432682.746943:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787432682.746950:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812776704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432682.746985:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812776704:12345-0@lo:400:kworker.0 Request processed in 35us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432682.746992:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787432682.747017:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812777088 00000100:00100000:2.0:1787432682.747021:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812777088 00000100:00100000:2.0:1787432682.747059:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812776832 00000100:00100000:2.0:1787432682.747063:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812776832 00000100:00100000:2.0:1787432682.747084:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787432682.747091:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812777088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432682.747124:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812777088:12345-0@lo:400:kworker.0 Request processed in 33us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432682.747140:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787432682.747152:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787432682.747158:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812776832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432682.747201:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812776832:12345-0@lo:400:kworker.0 Request processed in 43us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432682.747207:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787432682.747269:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812776576:0@lo:400:kworker.0 00010000:00080000:2.0:1787432682.747287:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa50000 x1874258812777088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432682.747299:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812777088:0@lo:400:kworker.0 00000100:00100000:2.0:1787432682.747308:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812776448:0@lo:400:kworker.0 00000100:00100000:2.0:1787432682.747317:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812776960:0@lo:400:kworker.0 00000100:00080000:2.0:1787432682.747357:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787432682.747362:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787432682.747365:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787432682.747390:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa53b80 x1874258812776832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432682.747399:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812776832:0@lo:400:kworker.0 00000100:00100000:2.0:1787432682.747412:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812776704:0@lo:400:kworker.0 00000001:00100000:0.0:1787432682.822262:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5c1bafcc-88f0-4bc2-9523-0dc619fa83f5 00000100:00100000:2.0:1787432683.257775:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812777216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432683.257847:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432683.258211:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812777216 00000100:00100000:3.0:1787432683.258220:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812777216 00000100:00100000:3.0:1787432683.258273:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787432683.258283:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812777216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432683.258319:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787432683.258366:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812777216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432683.258374:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787432683.261109:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb9556680 x1874258812777216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432683.261149:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812777216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432683.261177:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432683.261186:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb6e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812777344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432683.261243:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432683.261295:0:9985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812777344 00000100:00100000:2.0:1787432683.261301:0:9985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812777344 00000100:00100000:2.0:1787432683.261344:0:9985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787432683.261353:0:9985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812777344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432683.261383:0:9985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432683.261425:0:9985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812777344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432683.261432:0:9985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787432683.261460:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbb6e2300 x1874258812777344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432683.261472:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb6e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812777344:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787432683.336588:0:5889:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5c1bafcc-88f0-4bc2-9523-0dc619fa83f5 00010000:00010000:2.0:1787432683.638221:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432684.464868:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432684.464940:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432684.464988:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432684.465021:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432684.465061:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432684.465162:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791771776 00000100:00100000:0.0:1787432684.465175:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791771776 00000100:00100000:0.0:1787432684.465257:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 221 00000100:00100000:0.0:1787432684.465271:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2376:x1874258791771776:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432684.465368:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2376:x1874258791771776:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 101us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432684.465394:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 221 00000100:00100000:3.0:1787432684.465395:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791772160 00000100:00100000:3.0:1787432684.465402:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791772160 00000100:00100000:3.0:1787432684.465451:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791772288 00000100:00100000:3.0:1787432684.465455:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791772288 00000100:00100000:3.0:1787432684.465481:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:3.0:1787432684.465489:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2376:x1874258791772160:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432684.465543:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2376:x1874258791772160:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 55us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432684.465551:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:3.0:1787432684.465580:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:3.0:1787432684.465588:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2376:x1874258791772288:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432684.465638:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2376:x1874258791772288:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 51us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432684.465644:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:2.0:1787432684.465850:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791771904 00000100:00100000:2.0:1787432684.465856:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791771904 00000100:00080000:0.0:1787432684.465874:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787432684.465883:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787432684.465886:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432684.465906:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791772032 00000100:00100000:2.0:1787432684.465911:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:0.0:1787432684.465911:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791772032 00000100:00100000:2.0:1787432684.465927:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:2376:x1874258791771904:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432684.465960:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 70 00000100:00100000:0.0:1787432684.465970:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2376:x1874258791772032:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787432684.465976:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:2376:x1874258791771904:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 52us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432684.465984:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:0.0:1787432684.466005:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2376:x1874258791772032:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 35us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432684.466014:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 70 00000100:00080000:0.0:1787432684.466035:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787432684.663529:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432685.686933:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787432685.781126:0:10357:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1787432686.713980:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432687.734605:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432687.864594:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812777472:0@lo:400:kworker.0 00000100:00100000:3.0:1787432687.864694:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432687.864741:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812777984:0@lo:400:kworker.0 00000100:00100000:3.0:1787432687.864768:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432687.864794:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787432687.864799:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812777600:0@lo:400:kworker.0 00000100:00100000:3.0:1787432687.864819:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432687.864835:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812778112:0@lo:400:kworker.0 00000100:00100000:3.0:1787432687.864857:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432687.864885:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812777728:0@lo:400:kworker.0 00000100:00100000:3.0:1787432687.864906:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432687.864924:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432687.864930:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812777856:0@lo:400:kworker.0 00000100:00100000:3.0:1787432687.864949:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432687.864981:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812777472 00000100:00100000:3.0:1787432687.864988:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812777472 00000100:00100000:3.0:1787432687.865036:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787432687.865046:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812777472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432687.865095:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812777472:12345-0@lo:400:kworker.0 Request processed in 50us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432687.865103:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787432687.865134:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812777984 00000100:00100000:3.0:1787432687.865137:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812777984 00000100:00100000:3.0:1787432687.865170:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812777600 00000100:00100000:3.0:1787432687.865173:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812777600 00000100:00100000:3.0:1787432687.865187:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812777728 00000100:00100000:3.0:1787432687.865189:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812777728 00000100:00100000:3.0:1787432687.865204:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787432687.865220:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812777984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432687.865254:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812777984:12345-0@lo:400:kworker.0 Request processed in 35us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432687.865260:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787432687.865272:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787432687.865277:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812777600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432687.865302:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812777600:12345-0@lo:400:kworker.0 Request processed in 25us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432687.865308:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787432687.865319:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787432687.865436:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812777728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432687.865472:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812777728:12345-0@lo:400:kworker.0 Request processed in 148us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432687.865480:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787432687.865503:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812778112 00000100:00100000:3.0:1787432687.865507:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812778112 00000100:00100000:3.0:1787432687.865543:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812777856 00000100:00100000:3.0:1787432687.865547:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812777856 00000100:00100000:3.0:1787432687.865570:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787432687.865576:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812778112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432687.865605:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812778112:12345-0@lo:400:kworker.0 Request processed in 30us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432687.865611:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787432687.865621:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787432687.865627:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812777856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432687.865654:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812777856:12345-0@lo:400:kworker.0 Request processed in 27us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432687.865685:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1787432687.865712:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787432687.865716:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432687.865718:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787432687.865758:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb9554380 x1874258812777856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432687.865771:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812777856:0@lo:400:kworker.0 00000100:00100000:3.0:1787432687.865784:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812777728:0@lo:400:kworker.0 00000100:00100000:3.0:1787432687.865816:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812777600:0@lo:400:kworker.0 00010000:00080000:3.0:1787432687.865827:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbabbaa00 x1874258812778112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432687.865835:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812778112:0@lo:400:kworker.0 00000100:00100000:3.0:1787432687.865842:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812777472:0@lo:400:kworker.0 00000100:00100000:3.0:1787432687.865850:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812777984:0@lo:400:kworker.0 00000100:00100000:0.0:1787432688.376932:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432688.376958:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812778240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432688.377029:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432688.377198:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb6e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812778368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432688.377224:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432688.377456:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812778240 00000100:00100000:2.0:1787432688.377464:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812778240 00000100:00100000:2.0:1787432688.377510:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812778368 00000100:00100000:2.0:1787432688.377512:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812778368 00000100:00100000:2.0:1787432688.377537:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787432688.377546:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812778240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432688.377584:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432688.377640:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812778240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432688.377647:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787432688.377696:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787432688.377703:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812778368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432688.377720:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432688.377918:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812778368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 215us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432688.377925:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1787432688.377965:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbb6e3800 x1874258812778368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432688.377983:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb6e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812778368:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787432688.378005:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbabbc380 x1874258812778240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432688.378015:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812778240:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787432688.759414:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432689.584775:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432689.584841:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432689.584872:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432689.584905:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432689.584946:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432689.585092:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791772544 00000100:00100000:3.0:1787432689.585102:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791772544 00000100:00100000:3.0:1787432689.585168:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791772672 00000100:00100000:3.0:1787432689.585171:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791772672 00000100:00100000:3.0:1787432689.585195:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 74 00000100:00100000:3.0:1787432689.585205:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791772544:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432689.585295:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791772544:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 91us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432689.585302:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 74 00000100:00100000:3.0:1787432689.585326:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 75 00000100:00100000:3.0:1787432689.585332:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2375:x1874258791772672:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432689.585356:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2375:x1874258791772672:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 24us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432689.585362:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 75 00000100:00100000:3.0:1787432689.585381:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791772800 00000100:00100000:3.0:1787432689.585384:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791772800 00000100:00100000:3.0:1787432689.585407:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791772928 00000100:00100000:3.0:1787432689.585410:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791772928 00000100:00100000:3.0:1787432689.585428:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:3.0:1787432689.585434:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2375:x1874258791772800:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432689.585458:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2375:x1874258791772800:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 24us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432689.585464:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:3.0:1787432689.585627:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:3.0:1787432689.585634:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba866680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2375:x1874258791772928:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432689.585687:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba866680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2375:x1874258791772928:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 24us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432689.585694:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00080000:0.0:1787432689.586144:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787432689.586149:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787432689.586152:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432689.586467:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791772416 00000100:00100000:2.0:1787432689.586473:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791772416 00000100:00100000:2.0:1787432689.586535:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 223 00000100:00100000:2.0:1787432689.586553:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87906850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2375:x1874258791772416:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787432689.586602:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87906850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2375:x1874258791772416:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 50us (1729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432689.586609:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 223 00010000:00010000:3.0:1787432689.781973:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432690.807825:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432691.830020:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432692.858331:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432692.986139:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba865500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812778496:0@lo:400:kworker.0 00000100:00100000:3.0:1787432692.986227:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432692.986268:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812779008:0@lo:400:kworker.0 00000100:00100000:3.0:1787432692.986290:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432692.986312:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787432692.986327:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812778624:0@lo:400:kworker.0 00000100:00100000:3.0:1787432692.986346:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432692.986358:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812779136:0@lo:400:kworker.0 00000100:00100000:3.0:1787432692.986376:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432692.986404:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812778496 00000100:00100000:3.0:1787432692.986411:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812778496 00000100:00100000:3.0:1787432692.986450:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787432692.986470:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812778496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432692.986528:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812778496:12345-0@lo:400:kworker.0 Request processed in 70us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432692.986535:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787432692.986565:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812779008 00000100:00100000:3.0:1787432692.986569:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812779008 00000100:00100000:3.0:1787432692.986601:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812778624 00000100:00100000:3.0:1787432692.986605:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812778624 00000100:00100000:3.0:1787432692.986620:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787432692.986626:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812779008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432692.986938:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812779008:12345-0@lo:400:kworker.0 Request processed in 29us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432692.986946:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787432692.986963:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787432692.986969:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812778624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432692.986999:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812778624:12345-0@lo:400:kworker.0 Request processed in 31us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432692.987005:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787432692.987023:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812779136 00000100:00100000:3.0:1787432692.987026:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812779136 00000100:00100000:3.0:1787432692.987059:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787432692.987064:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812779136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432692.987090:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812779136:12345-0@lo:400:kworker.0 Request processed in 27us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432692.987096:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1787432692.987111:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432692.987115:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432692.988337:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812778624:0@lo:400:kworker.0 00010000:00080000:3.0:1787432692.988371:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bba867480 x1874258812779136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432692.988383:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812779136:0@lo:400:kworker.0 00000100:00100000:3.0:1787432692.988393:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba865500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812778496:0@lo:400:kworker.0 00000100:00100000:3.0:1787432692.988404:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812779008:0@lo:400:kworker.0 00000100:00100000:3.0:1787432692.988471:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba865c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812778752:0@lo:400:kworker.0 00000100:00100000:3.0:1787432692.988526:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432692.990721:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812778752 00000100:00100000:0.0:1787432692.990737:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812778752 00000100:00100000:0.0:1787432692.990800:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787432692.990811:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812778752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432692.990900:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812778752:12345-0@lo:400:kworker.0 Request processed in 91us (2373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432692.990908:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787432692.991937:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432692.991960:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812778880:0@lo:400:kworker.0 00000100:00100000:3.0:1787432692.992013:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432692.992063:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba865c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812778752:0@lo:400:kworker.0 00000100:00080000:3.0:1787432692.992089:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432692.992101:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812778880 00000100:00100000:3.0:1787432692.992105:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812778880 00000100:00100000:3.0:1787432692.993281:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787432692.993332:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432692.993354:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812778880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432692.993468:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812778880:12345-0@lo:400:kworker.0 Request processed in 172us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432692.993486:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1787432692.994599:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bba864380 x1874258812778880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432692.994618:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812778880:0@lo:400:kworker.0 00000100:00100000:2.0:1787432693.501157:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812779264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432693.501229:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432693.501299:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812779264 00000100:00100000:3.0:1787432693.501308:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812779264 00000100:00100000:3.0:1787432693.501358:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787432693.501367:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812779264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787432693.501399:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787432693.501447:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812779264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432693.501534:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787432693.503210:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbabbbb80 x1874258812779264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432693.503236:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812779264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432693.503261:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432693.503269:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812779392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432693.503320:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432693.503414:0:9985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812779392 00000100:00100000:0.0:1787432693.503422:0:9985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812779392 00000100:00100000:0.0:1787432693.503483:0:9985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787432693.503494:0:9985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812779392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432693.503526:0:9985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787432693.503575:0:9985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812779392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432693.503583:0:9985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1787432693.503612:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bba864380 x1874258812779392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432693.503640:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812779392:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787432693.886861:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432694.706499:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432694.706544:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432694.706570:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432694.706586:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432694.706605:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432694.706983:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791773056 00000100:00100000:3.0:1787432694.706996:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791773056 00000100:00100000:3.0:1787432694.707074:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 225 00000100:00100000:3.0:1787432694.707085:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2375:x1874258791773056:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432694.707177:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2375:x1874258791773056:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 93us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432694.707185:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 225 00000100:00100000:3.0:1787432694.707233:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791773312 00000100:00100000:3.0:1787432694.707238:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791773312 00000100:00100000:3.0:1787432694.707273:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791773184 00000100:00100000:3.0:1787432694.707277:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791773184 00000100:00100000:3.0:1787432694.707299:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 79 00000100:00100000:3.0:1787432694.707306:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2375:x1874258791773312:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432694.707340:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2375:x1874258791773312:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 35us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432694.707363:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 79 00000100:00100000:3.0:1787432694.707389:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 80 00000100:00100000:3.0:1787432694.707397:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791773184:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432694.707424:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791773184:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 29us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432694.707431:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 80 00000100:00100000:3.0:1787432694.707451:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791773568 00000100:00100000:3.0:1787432694.707455:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791773568 00000100:00100000:3.0:1787432694.707491:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791773440 00000100:00100000:3.0:1787432694.707494:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791773440 00000100:00100000:3.0:1787432694.707515:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:3.0:1787432694.707521:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2375:x1874258791773568:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432694.707547:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2375:x1874258791773568:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 27us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432694.707553:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:3.0:1787432694.707564:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:3.0:1787432694.707570:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba864000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2375:x1874258791773440:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432694.707595:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba864000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2375:x1874258791773440:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 25us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432694.707601:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00080000:3.0:1787432694.708078:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787432694.708083:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432694.708086:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787432694.902060:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432695.925990:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432696.950719:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432697.976806:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432698.122119:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b98b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812779520:0@lo:400:kworker.0 00000100:00100000:3.0:1787432698.122195:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b98b1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812779648:0@lo:400:kworker.0 00000100:00100000:2.0:1787432698.122204:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432698.122257:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b98b1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812780032:0@lo:400:kworker.0 00000100:00100000:2.0:1787432698.122283:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432698.122308:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432698.122326:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b98b18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812779904:0@lo:400:kworker.0 00000100:00100000:3.0:1787432698.122339:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b98b1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812780160:0@lo:400:kworker.0 00000100:00100000:2.0:1787432698.122356:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432698.122377:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432698.122383:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b98b19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3331:1874258812779776:0@lo:400:kworker.0 00000100:00100000:2.0:1787432698.122405:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432698.122446:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432698.122482:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812780032 00000100:00100000:3.0:1787432698.122490:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812780032 00000100:00100000:3.0:1787432698.122540:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812779648 00000100:00100000:3.0:1787432698.122543:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812779648 00000100:00100000:3.0:1787432698.122565:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787432698.122575:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812780032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432698.122631:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812780032:12345-0@lo:400:kworker.0 Request processed in 57us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432698.122639:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787432698.122676:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787432698.122684:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812779648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432698.122720:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812779648:12345-0@lo:400:kworker.0 Request processed in 34us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432698.122726:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787432698.122746:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812779904 00000100:00100000:3.0:1787432698.122749:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812779904 00000100:00100000:3.0:1787432698.122775:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812780160 00000100:00100000:3.0:1787432698.122779:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812780160 00000100:00100000:3.0:1787432698.122797:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787432698.122804:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812779904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432698.122836:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812779904:12345-0@lo:400:kworker.0 Request processed in 32us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432698.122842:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787432698.122862:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787432698.122868:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812780160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432698.122898:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812780160:12345-0@lo:400:kworker.0 Request processed in 30us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432698.122903:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1787432698.122922:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432698.122925:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787432698.122928:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432698.122963:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b98b1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812779648:0@lo:400:kworker.0 00010000:00080000:3.0:1787432698.122983:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935b98b1a300 x1874258812780160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432698.122994:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b98b1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812780160:0@lo:400:kworker.0 00000100:00100000:3.0:1787432698.123038:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b98b1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812780032:0@lo:400:kworker.0 00000100:00100000:3.0:1787432698.123069:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812779520 00000100:00100000:3.0:1787432698.123073:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812779520 00000100:00100000:3.0:1787432698.123097:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787432698.123103:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812779520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432698.123137:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812779520:12345-0@lo:400:kworker.0 Request processed in 34us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432698.123143:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787432698.123177:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b98b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812779520:0@lo:400:kworker.0 00010000:00080000:2.0:1787432698.123879:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935b98b18a80 x1874258812779904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432698.123892:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b98b18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812779904:0@lo:400:kworker.0 00000100:00100000:1.0:1787432698.124322:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812779776 00000100:00100000:1.0:1787432698.124329:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812779776 00000100:00100000:1.0:1787432698.124480:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787432698.124498:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3331:x1874258812779776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432698.124570:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3331:x1874258812779776:12345-0@lo:400:kworker.0 Request processed in 74us (2162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432698.124578:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1787432698.124600:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432698.124634:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b98b19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3331:1874258812779776:0@lo:400:kworker.0 00000100:00100000:3.0:1787432698.613935:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432698.613964:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812780288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432698.614049:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432698.614130:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812780288 00000100:00100000:3.0:1787432698.614149:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812780288 00000100:00100000:3.0:1787432698.614206:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787432698.614216:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812780288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787432698.614263:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787432698.614317:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812780288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432698.614325:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787432698.614364:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbabb9180 x1874258812780288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432698.614382:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812780288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432698.614753:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432698.614762:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812780416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432698.614793:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432698.614827:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812780416 00000100:00100000:3.0:1787432698.614831:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812780416 00000100:00100000:3.0:1787432698.614857:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787432698.614864:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812780416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432698.614885:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787432698.614920:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812780416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432698.614927:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1787432698.614953:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbabb9180 x1874258812780416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432698.614967:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812780416:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787432699.000927:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432699.842461:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432699.842519:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432699.842632:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432699.842829:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791773696 00000100:00100000:0.0:1787432699.842844:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791773696 00000100:00100000:0.0:1787432699.842926:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 227 00000100:00100000:0.0:1787432699.842939:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2376:x1874258791773696:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432699.843039:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2376:x1874258791773696:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 102us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432699.843050:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 227 00000100:00100000:1.0:1787432699.845784:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432699.845871:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432699.845977:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791774080 00000100:00100000:1.0:1787432699.845990:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791774080 00000100:00100000:1.0:1787432699.846074:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791774208 00000100:00100000:1.0:1787432699.846078:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791774208 00000100:00100000:1.0:1787432699.846108:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:1.0:1787432699.846120:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2374:x1874258791774080:12345-192.168.202.15@tcp:9:kworker.0 00000020:00000080:1.0:1787432699.846165:0:6724:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0fb13 00000100:00080000:1.0:1787432699.846178:0:6724:0:(import.c:65:import_set_state_nolock()) ffff935b87528000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787432699.846235:0:6724:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787432699.846775:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+2:2374:x1874258791774080:12345-192.168.202.15@tcp:9:kworker.0 Request processed in 654us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432699.846786:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:1.0:1787432699.846809:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:1.0:1787432699.846818:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2374:x1874258791774208:12345-192.168.202.15@tcp:9:kworker.0 00000020:00000080:1.0:1787432699.846833:0:6724:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0fb1a 00000100:00080000:1.0:1787432699.846858:0:6724:0:(import.c:65:import_set_state_nolock()) ffff935b8752c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787432699.846888:0:6724:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787432699.847110:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+2:2374:x1874258791774208:12345-192.168.202.15@tcp:9:kworker.0 Request processed in 292us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432699.847117:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00080000:1.0:1787432699.847144:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432699.847150:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787432699.847185:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432699.847396:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432699.850821:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791773952 00000100:00100000:2.0:1787432699.850846:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791773952 00000100:00100000:3.0:1787432699.854826:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791773824 00000100:00100000:3.0:1787432699.854850:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791773824 00000100:00100000:3.0:1787432699.855138:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00100000:3.0:1787432699.855152:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:2376:x1874258791773824:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432699.855282:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:2376:x1874258791773824:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 133us (12649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432699.855292:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00080000:1.0:1787432699.855863:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787432699.856760:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432699.857988:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 85 00000100:00100000:0.0:1787432699.858023:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2376:x1874258791773952:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432699.858159:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2376:x1874258791773952:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 153us (15637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432699.858168:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 85 00010000:00010000:3.0:1787432700.021878:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432701.048074:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432702.071915:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787432702.758092:0:6749:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5c1bafcc-88f0-4bc2-9523-0dc619fa83f5 00000020:00000080:0.0:1787432702.758105:0:6749:0:(genops.c:885:class_export_put()) final put ffff935b8752d800/5c1bafcc-88f0-4bc2-9523-0dc619fa83f5 00000020:00000080:1.0:1787432702.758473:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff935b8752d800/5c1bafcc-88f0-4bc2-9523-0dc619fa83f5 for lustre-OST0000 00000020:00000080:1.0:1787432702.758540:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935b87528000 for lustre-OST0000 00010000:00010000:3.0:1787432703.094880:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432703.222901:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812780544:0@lo:400:kworker.0 00000100:00100000:3.0:1787432703.223006:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432703.223074:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba866300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812781056:0@lo:400:kworker.0 00000100:00100000:3.0:1787432703.223106:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432703.223140:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787432703.223145:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812780672:0@lo:400:kworker.0 00000100:00100000:3.0:1787432703.223167:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432703.223185:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812781184:0@lo:400:kworker.0 00000100:00100000:3.0:1787432703.223209:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432703.223244:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812780800:0@lo:400:kworker.0 00000100:00100000:3.0:1787432703.223270:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432703.223293:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432703.223299:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba866a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812780928:0@lo:400:kworker.0 00000100:00100000:3.0:1787432703.223332:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432703.223374:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812780544 00000100:00100000:3.0:1787432703.223396:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812780544 00000100:00100000:3.0:1787432703.223475:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787432703.223486:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812780544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432703.223548:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812780544:12345-0@lo:400:kworker.0 Request processed in 63us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432703.223555:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787432703.223594:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812781056 00000100:00100000:3.0:1787432703.223598:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812781056 00000100:00100000:3.0:1787432703.223641:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812780672 00000100:00100000:3.0:1787432703.223644:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812780672 00000100:00100000:3.0:1787432703.223691:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812780800 00000100:00100000:3.0:1787432703.223695:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812780800 00000100:00100000:3.0:1787432703.223712:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787432703.223718:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812781056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432703.223753:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812781056:12345-0@lo:400:kworker.0 Request processed in 35us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432703.223759:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787432703.223771:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787432703.223777:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812780672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432703.223805:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812780672:12345-0@lo:400:kworker.0 Request processed in 28us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432703.223810:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787432703.223821:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787432703.223827:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812780800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432703.223858:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812780800:12345-0@lo:400:kworker.0 Request processed in 31us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432703.223864:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787432703.223887:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812781184 00000100:00100000:3.0:1787432703.223898:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812781184 00000100:00100000:3.0:1787432703.223931:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812780928 00000100:00100000:3.0:1787432703.223934:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812780928 00000100:00100000:3.0:1787432703.223952:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787432703.223957:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812781184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432703.223990:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812781184:12345-0@lo:400:kworker.0 Request processed in 33us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432703.223997:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787432703.224007:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787432703.224013:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812780928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432703.224043:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812780928:12345-0@lo:400:kworker.0 Request processed in 30us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432703.224049:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787432703.224081:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787432703.224086:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432703.224089:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787432703.224211:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bba866a00 x1874258812780928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432703.224228:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba866a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812780928:0@lo:400:kworker.0 00000100:00100000:3.0:1787432703.224243:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812780800:0@lo:400:kworker.0 00000100:00100000:3.0:1787432703.224283:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba865880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812780672:0@lo:400:kworker.0 00010000:00080000:3.0:1787432703.224297:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bba864700 x1874258812781184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432703.224309:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812781184:0@lo:400:kworker.0 00000100:00100000:3.0:1787432703.224320:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812780544:0@lo:400:kworker.0 00000100:00100000:3.0:1787432703.224342:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba866300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812781056:0@lo:400:kworker.0 00000001:00100000:1.0:1787432703.398872:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5c1bafcc-88f0-4bc2-9523-0dc619fa83f5 00000020:00000080:1.0:1787432703.398887:0:7682:0:(genops.c:885:class_export_put()) final put ffff935b8752a000/5c1bafcc-88f0-4bc2-9523-0dc619fa83f5 00000020:00000080:2.0:1787432703.399126:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff935b8752a000/5c1bafcc-88f0-4bc2-9523-0dc619fa83f5 for lustre-OST0001 00000020:00000080:2.0:1787432703.399196:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935b8752c800 for lustre-OST0001 00000100:00100000:0.0:1787432703.734468:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812781312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432703.734542:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b98b18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812781440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432703.734594:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432703.734632:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812781312 00000100:00100000:2.0:1787432703.734642:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812781312 00000100:00100000:2.0:1787432703.734736:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787432703.734859:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432703.734914:0:9985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812781440 00000100:00100000:0.0:1787432703.734919:0:9985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812781440 00000100:00100000:2.0:1787432703.735239:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812781312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432703.735489:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787432703.735533:0:9985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787432703.735545:0:9985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812781440:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432703.735562:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812781312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 327us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432703.735572:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00002000:00000024:0.0:1787432703.735573:0:9985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787432703.736932:0:9985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812781440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1382us (2064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432703.736944:0:9985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1787432703.736990:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935b98b18a80 x1874258812781440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432703.737191:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b98b18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812781440:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787432703.745450:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbabbbb80 x1874258812781312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432703.745492:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812781312:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787432704.120616:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787432704.799933:0:11059:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787432704.953583:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432704.953631:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432704.953679:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432704.953711:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791774336 00000100:00100000:1.0:1787432704.953724:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791774336 00000100:00100000:1.0:1787432704.953786:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 229 00000100:00100000:1.0:1787432704.953798:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2377:x1874258791774336:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432704.953897:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2377:x1874258791774336:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 100us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432704.953924:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 229 00000100:00100000:3.0:1787432704.956279:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791774592 00000100:00100000:3.0:1787432704.956295:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791774592 00000100:00100000:3.0:1787432704.961082:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791774464 00000100:00100000:3.0:1787432704.961103:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791774464 00000100:00100000:3.0:1787432704.961172:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 89 00000100:00100000:3.0:1787432704.961184:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2377:x1874258791774592:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432704.961284:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2377:x1874258791774592:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 102us (7651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432704.961292:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 89 00000100:00100000:3.0:1787432704.961311:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 90 00000100:00100000:3.0:1787432704.961317:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+6:2377:x1874258791774464:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432704.961340:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+6:2377:x1874258791774464:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 24us (7661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432704.961346:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 90 00000100:00080000:3.0:1787432704.963764:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787432705.142100:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432706.170736:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432707.189888:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432708.214821:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432708.346749:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b98b19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812781824:0@lo:400:kworker.0 00000100:00100000:2.0:1787432708.346852:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432708.346932:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432708.346938:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b98b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812781952:0@lo:400:kworker.0 00000100:00100000:2.0:1787432708.346987:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432708.347072:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b98b18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812781696:0@lo:400:kworker.0 00000100:00100000:2.0:1787432708.347101:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432708.347120:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b98b1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812782208:0@lo:400:kworker.0 00000100:00100000:2.0:1787432708.347143:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432708.347175:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787432708.347181:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b98b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812781568:0@lo:400:kworker.0 00000100:00100000:2.0:1787432708.347221:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432708.347264:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b98b1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3333:1874258812782080:0@lo:400:kworker.0 00000100:00100000:2.0:1787432708.347289:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432708.347352:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812781952 00000100:00100000:2.0:1787432708.347362:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812781952 00000100:00100000:2.0:1787432708.347431:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812782208 00000100:00100000:2.0:1787432708.347434:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812782208 00000100:00100000:2.0:1787432708.347459:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787432708.347469:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812781952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432708.347534:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812781952:12345-0@lo:400:kworker.0 Request processed in 66us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432708.347543:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787432708.347563:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787432708.347569:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812782208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432708.347605:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812782208:12345-0@lo:400:kworker.0 Request processed in 36us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432708.347611:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1787432708.347685:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935b98b1a300 x1874258812782208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432708.347719:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b98b1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812782208:0@lo:400:kworker.0 00010000:00080000:2.0:1787432708.347758:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935b98b18000 x1874258812781952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432708.347767:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b98b18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812781952:0@lo:400:kworker.0 00000100:00100000:2.0:1787432708.347798:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812781824 00000100:00100000:2.0:1787432708.347802:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812781824 00000100:00100000:2.0:1787432708.347838:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812781696 00000100:00100000:2.0:1787432708.347841:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812781696 00000100:00100000:2.0:1787432708.347859:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812782080 00000100:00100000:2.0:1787432708.347862:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812782080 00000100:00100000:2.0:1787432708.347878:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787432708.347885:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812781824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432708.347925:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812781824:12345-0@lo:400:kworker.0 Request processed in 41us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432708.347931:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787432708.347944:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787432708.347949:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812781696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432708.347979:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812781696:12345-0@lo:400:kworker.0 Request processed in 31us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432708.347985:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787432708.347996:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787432708.348001:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1874258812782080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432708.348027:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1874258812782080:12345-0@lo:400:kworker.0 Request processed in 27us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432708.348033:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787432708.348061:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812781568 00000100:00100000:2.0:1787432708.348065:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812781568 00000100:00100000:2.0:1787432708.348094:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787432708.348101:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3333:x1874258812781568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432708.348132:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3333:x1874258812781568:12345-0@lo:400:kworker.0 Request processed in 31us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432708.348138:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787432708.348176:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b98b19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812781824:0@lo:400:kworker.0 00000100:00100000:2.0:1787432708.348199:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b98b1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812781568:0@lo:400:kworker.0 00000100:00100000:2.0:1787432708.348209:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b98b1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3333:1874258812782080:0@lo:400:kworker.0 00000100:00100000:2.0:1787432708.348219:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b98b18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812781696:0@lo:400:kworker.0 00000100:00080000:2.0:1787432708.348252:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787432708.348258:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787432708.348260:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1787432708.823990:0:11208:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd697d080 20000000:00000080:1.0:1787432708.824013:0:11208:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff935b87c42800 uarg=0000000000000000 20000000:01000000:1.0:1787432708.824060:0:11208:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787432708.824129:0:11208:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787432708.824136:0:11208:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787432708.825510:0:11209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787432708.826531:0:11208:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787432708.832531:0:11208:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787432708.832579:0:11208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb21 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.832608:0:11208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bc2166800/0xbcb9e331c3f0fac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b27 expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.832617:0:11208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bc2167a00/0xbcb9e331c3f0fad4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0facd expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.832622:0:11208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bbaa5f800/0xbcb9e331c3f0fae2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fadb expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.832626:0:11208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bbaa5e200/0xbcb9e331c3f0faf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fae9 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.832630:0:11208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bbaa5f000/0xbcb9e331c3f0fb05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b5f expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.832634:0:11208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb21 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.832730:0:11208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bbaa5f000/0xbcb9e331c3f0fb05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b5f expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.832766:0:11208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff935bbaa5f000/0xbcb9e331c3f0fb05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b5f expref: 12 pid: 5860 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432708.832786:0:11208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb6e1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11208:1874258812782336:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787432708.832932:0:11208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bbaa5e200/0xbcb9e331c3f0faf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0fae9 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.832940:0:11208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bbaa5e200/0xbcb9e331c3f0faf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0fae9 expref: 18 pid: 5860 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432708.832949:0:11208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb6e3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11208:1874258812782464:0@lo:104: 00000100:00100000:1.0:1787432708.833019:0:11208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787432708.833063:0:11208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bbaa5f800/0xbcb9e331c3f0fae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0fadb expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.833073:0:11208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bbaa5f800/0xbcb9e331c3f0fae2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0fadb expref: 18 pid: 5862 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432708.833082:0:11208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba45ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11208:1874258812782592:0@lo:104: 00000100:00100000:1.0:1787432708.833119:0:11208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432708.833132:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812782464 00000100:00100000:0.0:1787432708.833142:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812782464 00010000:00010000:1.0:1787432708.833148:0:11208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bc2167a00/0xbcb9e331c3f0fad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0facd expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.833156:0:11208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bc2167a00/0xbcb9e331c3f0fad4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0facd expref: 18 pid: 5861 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432708.833164:0:11208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba45d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11208:1874258812782720:0@lo:104: 00000100:00100000:1.0:1787432708.833186:0:11208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432708.833212:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812782592 00010000:00010000:1.0:1787432708.833215:0:11208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bc2166800/0xbcb9e331c3f0fac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b27 expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432708.833216:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812782592 00010000:00010000:1.0:1787432708.833224:0:11208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff935bc2166800/0xbcb9e331c3f0fac6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b27 expref: 12 pid: 5861 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432708.833227:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812782720 00000100:00100000:0.0:1787432708.833230:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812782720 00000100:00100000:1.0:1787432708.833233:0:11208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba45dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11208:1874258812782848:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787432708.833243:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787432708.833254:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+5:11208:x1874258812782464:12345-0@lo:104: 00010000:00010000:0.0:1787432708.833269:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f400/0xbcb9e331c3f0fae9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0faf0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432708.833298:0:11208:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb9563d80 going to sleep for 11 seconds 00010000:00010000:0.0:1787432708.833328:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787432708.833345:0:11208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb6e3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11208:1874258812782464:0@lo:104: 00000100:00100000:0.0:1787432708.833375:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+5:11208:x1874258812782464:12345-0@lo:104: Request processed in 122us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432708.833383:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787432708.833412:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787432708.833418:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+4:11208:x1874258812782592:12345-0@lo:104: 00010000:00010000:0.0:1787432708.833427:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fe00/0xbcb9e331c3f0fadb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0fae2 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432708.833477:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787432708.833482:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+4:11208:x1874258812782592:12345-0@lo:104: Request processed in 65us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432708.833495:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787432708.833514:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787432708.833520:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+3:11208:x1874258812782720:12345-0@lo:104: 00010000:00010000:0.0:1787432708.833528:0:5849:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bc2167200/0xbcb9e331c3f0facd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0fad4 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432708.833555:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787432708.833560:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+3:11208:x1874258812782720:12345-0@lo:104: Request processed in 41us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432708.833565:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787432708.833585:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787432708.833591:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f400/0xbcb9e331c3f0fae9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0faf0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432708.833599:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f400 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:0.0:1787432708.833604:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f400/0xbcb9e331c3f0fae9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0faf0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432708.833613:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f400/0xbcb9e331c3f0fae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0faf0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432708.833621:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f400/0xbcb9e331c3f0fae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0faf0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432708.833627:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787432708.833689:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f400/0xbcb9e331c3f0fae9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0faf0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432708.833696:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432708.833725:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f400/0xbcb9e331c3f0fae9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0faf0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432708.833732:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f400/0xbcb9e331c3f0fae9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0faf0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432708.833748:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787432708.833751:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fe00/0xbcb9e331c3f0fadb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0fae2 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432708.833757:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fe00 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:0.0:1787432708.833760:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fe00/0xbcb9e331c3f0fadb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0fae2 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432708.833766:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fe00/0xbcb9e331c3f0fadb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0fae2 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432708.833772:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fe00/0xbcb9e331c3f0fadb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0fae2 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432708.833919:0:11208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba45ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11208:1874258812782592:0@lo:104: 00000100:00100000:1.0:1787432708.833928:0:11208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba45d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11208:1874258812782720:0@lo:104: 00010000:00010000:2.0:1787432708.833935:0:5855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787432708.833982:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812782976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432708.834028:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432708.834077:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812782976 00000100:00100000:2.0:1787432708.834081:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812782976 00010000:00010000:2.0:1787432708.834105:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bbaa5e200/0xbcb9e331c3f0faf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0fae9 expref: 19 pid: 5860 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432708.834133:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787432708.834140:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935ba07d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812782976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432708.834152:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432708.834159:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bbaa5e200/0xbcb9e331c3f0faf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0fae9 expref: 19 pid: 5860 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432708.834179:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bbaa5e200/0xbcb9e331c3f0faf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0fae9 expref: 19 pid: 5860 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432708.834196:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bbaa5e200/0xbcb9e331c3f0faf0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0fae9 expref: 19 pid: 5860 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432708.834211:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432708.834239:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935ba07d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:3330:x1874258812782976:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432708.834245:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787432708.834307:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812782976:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1787432708.834448:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787432708.834482:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fe00/0xbcb9e331c3f0fadb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0fae2 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432708.834490:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432708.834502:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fe00/0xbcb9e331c3f0fadb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0fae2 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432708.834509:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fe00/0xbcb9e331c3f0fadb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0fae2 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432708.834519:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432708.834528:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432708.834530:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432708.834543:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812783104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432708.834575:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432708.834773:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812783104 00000100:00100000:1.0:1787432708.834778:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812783104 00010000:00010000:1.0:1787432708.834799:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bbaa5f800/0xbcb9e331c3f0fae2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0fadb expref: 18 pid: 5862 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432708.834839:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787432708.834846:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba866300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:3331:x1874258812783104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432708.834856:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432708.834861:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bbaa5f800/0xbcb9e331c3f0fae2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0fadb expref: 18 pid: 5862 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.834870:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bbaa5f800/0xbcb9e331c3f0fae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0fadb expref: 18 pid: 5862 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.834883:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bbaa5f800/0xbcb9e331c3f0fae2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0fadb expref: 18 pid: 5862 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.834893:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432708.834933:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba866300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:3331:x1874258812783104:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432708.834940:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787432708.835145:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812783104:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432708.835315:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432708.835318:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432708.835320:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432708.837491:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bc2167200/0xbcb9e331c3f0facd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0fad4 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432708.837511:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2167200 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:2.0:1787432708.837516:0:5855:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bc2167200/0xbcb9e331c3f0facd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0fad4 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432708.837527:0:5855:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bc2167200/0xbcb9e331c3f0facd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0fad4 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432708.837535:0:5855:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bc2167200/0xbcb9e331c3f0facd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0fad4 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432708.837541:0:5855:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787432708.837644:0:5855:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bc2167200/0xbcb9e331c3f0facd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0fad4 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432708.837652:0:5855:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787432708.837727:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bc2167200/0xbcb9e331c3f0facd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0fad4 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432708.837735:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bc2167200/0xbcb9e331c3f0facd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0fad4 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432708.837737:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1787432708.837759:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432708.837761:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432708.837762:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812783232:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432708.837764:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432708.837846:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432708.837914:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812783232 00000100:00100000:2.0:1787432708.837924:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812783232 00010000:00010000:2.0:1787432708.837960:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bc2167a00/0xbcb9e331c3f0fad4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0facd expref: 17 pid: 5861 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432708.838004:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787432708.838015:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:3333:x1874258812783232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432708.838030:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432708.838037:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bc2167a00/0xbcb9e331c3f0fad4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0facd expref: 17 pid: 5861 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432708.838047:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bc2167a00/0xbcb9e331c3f0fad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0facd expref: 17 pid: 5861 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432708.838075:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bc2167a00/0xbcb9e331c3f0fad4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0facd expref: 17 pid: 5861 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432708.838091:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432708.838145:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:3333:x1874258812783232:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432708.838153:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787432708.838172:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812783232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432708.839649:0:11208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb6e1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11208:1874258812782336:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787432708.839710:0:11208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba45dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11208:1874258812782848:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787432708.839765:0:11208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb21 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432708.841864:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432708.842006:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791774720 00000100:00100000:1.0:1787432708.842018:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791774720 00010000:00010000:1.0:1787432708.842068:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bbaa5f000/0xbcb9e331c3f0fb05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b5f expref: 13 pid: 5860 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432708.842129:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:1.0:1787432708.842141:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2375:x1874258791774720:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432708.842161:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432708.842169:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bbaa5f000/0xbcb9e331c3f0fb05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b5f expref: 13 pid: 5860 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.842184:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bbaa5f000/0xbcb9e331c3f0fb05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b5f expref: 13 pid: 5860 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.842208:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bbaa5f000/0xbcb9e331c3f0fb05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b5f expref: 13 pid: 5860 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.842242:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432708.842315:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:2375:x1874258791774720:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 176us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432708.842323:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:3.0:1787432708.845838:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432708.845973:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791774848 00000100:00100000:1.0:1787432708.845986:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791774848 00010000:00010000:1.0:1787432708.846036:0:8489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bc2166800/0xbcb9e331c3f0fac6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b27 expref: 12 pid: 5861 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432708.846076:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:1.0:1787432708.846087:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86830700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:2376:x1874258791774848:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432708.846107:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432708.846113:0:8489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bc2166800/0xbcb9e331c3f0fac6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b27 expref: 12 pid: 5861 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.846126:0:8489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bc2166800/0xbcb9e331c3f0fac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b27 expref: 12 pid: 5861 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.846144:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bc2166800/0xbcb9e331c3f0fac6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b27 expref: 12 pid: 5861 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.846161:0:8489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb21 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.846168:0:8489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb21 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.846184:0:8489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb21 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.846212:0:8489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb21 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.846220:0:8489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb21 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.846227:0:8489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb21 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.846235:0:8489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba417c00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432708.846240:0:8489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb21 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.846249:0:8489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb21 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.846271:0:8489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb21 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432708.846282:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432708.846357:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86830700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+11:2376:x1874258791774848:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 270us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432708.846365:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 29 00010000:00010000:3.0:1787432708.846767:0:11208:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb21 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432708.846776:0:11208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb21 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432708.846794:0:11208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb21 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432708.854073:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787432708.854366:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812783360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432708.854475:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432708.854878:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432708.854892:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812783488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432708.854927:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432708.860621:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812783360 00000100:00100000:1.0:1787432708.860642:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812783360 00000100:00100000:1.0:1787432708.862772:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812783488 00000100:00100000:1.0:1787432708.862801:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812783488 00000100:00100000:1.0:1787432708.862834:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787432708.862847:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812783360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432708.862917:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432708.863036:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812783360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 190us (8559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432708.863044:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787432708.863270:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787432708.863278:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812783488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787432708.863303:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432708.863357:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812783488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (8428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432708.863364:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787432708.863419:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa51180 x1874258812783360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432708.863445:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812783360:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787432708.863529:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bba864e00 x1874258812783488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432708.863545:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812783488:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787432709.238301:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432710.062412:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432710.062458:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432710.062485:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432710.063956:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791774976 00000100:00100000:2.0:1787432710.063972:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791774976 00000100:00100000:2.0:1787432710.064037:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 231 00000100:00100000:2.0:1787432710.064050:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+11:2375:x1874258791774976:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787432710.064148:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+11:2375:x1874258791774976:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 100us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432710.064157:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 231 00000100:00100000:2.0:1787432710.064193:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791775232 00000100:00100000:2.0:1787432710.064198:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791775232 00000100:00100000:2.0:1787432710.064229:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791775104 00000100:00100000:2.0:1787432710.064232:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791775104 00000100:00100000:2.0:1787432710.064251:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 94 00000100:00100000:2.0:1787432710.064257:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2375:x1874258791775232:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787432710.064288:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2375:x1874258791775232:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 31us (1831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432710.064294:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 94 00000100:00100000:2.0:1787432710.064304:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 95 00000100:00100000:2.0:1787432710.064309:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791775104:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787432710.064342:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791775104:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 32us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432710.064347:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 95 00000100:00080000:2.0:1787432710.064496:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432710.257625:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432710.258132:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791775360 00000100:00100000:1.0:1787432710.258143:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791775360 00000100:00100000:1.0:1787432710.258217:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 232 00000100:00100000:1.0:1787432710.258228:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+11:5619:x1874258791775360:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432710.258244:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432710.258534:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a025b89 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432710.258561:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b89 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432710.258582:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b89 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432710.258589:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba417c00, rc 0) 00000100:00100000:1.0:1787432710.258639:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:5619:x1874258791775360:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 415us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432710.258644:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 232 00000100:00100000:3.0:1787432710.261199:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432710.261297:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791775488 00000100:00100000:0.0:1787432710.261348:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791775488 00000100:00100000:0.0:1787432710.261410:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 233 00000100:00100000:0.0:1787432710.261423:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:5619:x1874258791775488:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432710.261778:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:5619:x1874258791775488:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 357us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432710.261787:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 233 00010000:00010000:0.0:1787432710.261828:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432710.264372:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432710.264766:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791775616 00000100:00100000:0.0:1787432710.264776:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791775616 00000100:00100000:0.0:1787432710.264838:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 234 00000100:00100000:0.0:1787432710.264848:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:5619:x1874258791775616:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432710.265068:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:5619:x1874258791775616:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 222us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432710.265081:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 234 00000100:00100000:0.0:1787432710.281789:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432710.281827:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791775744 00000100:00100000:1.0:1787432710.281838:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791775744 00000100:00100000:1.0:1787432710.281894:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 235 00000100:00100000:1.0:1787432710.281904:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:5619:x1874258791775744:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432710.281921:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432710.281944:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba417200/0xbcb9e331c3f0fb2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a025b90 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432710.281974:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba417200/0xbcb9e331c3f0fb2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b90 expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432710.281986:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba417200/0xbcb9e331c3f0fb2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b90 expref: 13 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432710.281996:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba417200, rc 0) 00000100:00100000:1.0:1787432710.282243:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:5619:x1874258791775744:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 338us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432710.282250:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 235 00000100:00100000:0.0:1787432710.288420:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432710.288504:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791775872 00000100:00100000:1.0:1787432710.288520:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791775872 00000100:00100000:1.0:1787432710.288577:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 236 00000100:00100000:1.0:1787432710.288587:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:5619:x1874258791775872:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432710.288905:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:5619:x1874258791775872:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 319us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432710.288913:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 236 00000100:00100000:1.0:1787432710.291298:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432710.291445:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791776000 00000100:00100000:0.0:1787432710.291454:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791776000 00000100:00100000:0.0:1787432710.291510:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 237 00000100:00100000:0.0:1787432710.291522:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:5619:x1874258791776000:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432710.291762:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:5619:x1874258791776000:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 241us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432710.291771:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 237 10000000:01000000:0.0:1787432710.773814:0:5864:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787432710.773822:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff935bbb06d800 from 7 10000000:01000000:0.0:1787432710.773827:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787432710.773872:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0fb36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432710.773884:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0fb36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432710.773896:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0fb36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432710.773922:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba864700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812783616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787432710.774004:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432710.774057:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9087d480 going to sleep for 11 seconds 00000100:00100000:1.0:1787432710.774289:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812783616 00000100:00100000:1.0:1787432710.774306:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812783616 00000100:00100000:1.0:1787432710.774365:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787432710.774374:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:5864:x1874258812783616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432710.774387:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432710.774400:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba417600/0xbcb9e331c3f0fb3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0fb36 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432710.774423:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba417600/0xbcb9e331c3f0fb3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fb36 expref: 17 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432710.774433:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba417600/0xbcb9e331c3f0fb3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fb36 expref: 17 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432710.774443:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba417600, rc 0) 00000100:00100000:1.0:1787432710.774653:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812783616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 278us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432710.774685:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787432710.774741:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba864700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812783616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432710.774755:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0fb36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fb3d expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432710.774772:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0fb36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fb3d expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432710.774828:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba45dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812783744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432710.774855:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432710.774880:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b82b3c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787432710.774936:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812783744 00000100:00100000:2.0:1787432710.774946:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812783744 00000100:00100000:2.0:1787432710.774992:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787432710.775000:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812783744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432710.775253:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812783744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432710.775260:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787432710.775289:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba45dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812783744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432710.775340:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812783872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432710.775376:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432710.775398:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b874e8540 going to sleep for 11 seconds 00000100:00100000:2.0:1787432710.775409:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812783872 00000100:00100000:2.0:1787432710.775412:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812783872 00000100:00100000:2.0:1787432710.775432:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787432710.775437:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812783872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432710.775734:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812783872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 295us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432710.775740:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787432710.775771:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812783872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787432710.776868:0:11275:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787432710.787523:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787432710.787560:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787432710.787573:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0fb36 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fb3d expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432710.787594:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0fb36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fb3d expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432710.787607:0:5864:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787432710.787610:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff935bbb3e4800 from 7 10000000:01000000:0.0:1787432710.787613:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787432710.787671:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0fb44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432710.787680:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0fb44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432710.787692:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0fb44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432710.787717:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba865880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812784000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787432710.787797:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432710.787847:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9087d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432710.788436:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812784000 00000100:00100000:1.0:1787432710.788448:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812784000 00000100:00100000:1.0:1787432710.788522:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787432710.788531:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812784000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432710.788546:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432710.788560:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba417a00/0xbcb9e331c3f0fb4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0fb44 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432710.788584:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba417a00/0xbcb9e331c3f0fb4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fb44 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432710.788594:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba417a00/0xbcb9e331c3f0fb4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fb44 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432710.788603:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba417a00, rc 0) 00000100:00100000:1.0:1787432710.788649:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812784000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432710.788675:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787432710.788839:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba865880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812784000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432710.788856:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0fb44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fb4b expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432710.788866:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0fb44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fb4b expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432710.788931:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba865880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812784128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432710.788960:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432710.789000:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9087d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432710.789235:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812784128 00000100:00100000:1.0:1787432710.789240:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812784128 00000100:00100000:1.0:1787432710.789278:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787432710.789292:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812784128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432710.791580:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812784128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2277us (2606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432710.791595:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787432710.792694:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba865880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812784128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432710.792759:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812784256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432710.792824:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432710.792864:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba0fdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432710.793811:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812784256 00000100:00100000:1.0:1787432710.793819:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812784256 00000100:00100000:1.0:1787432710.793867:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787432710.793876:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812784256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432710.794072:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812784256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432710.794080:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787432710.794230:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812784256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787432710.808190:0:11278:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787432710.808274:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787432710.808297:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787432710.808308:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0fb44 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fb4b expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432710.808334:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0fb44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fb4b expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432710.808345:0:5864:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787432710.808348:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff935b90e92000 from 7 10000000:01000000:1.0:1787432710.808351:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787432710.808389:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba416200/0xbcb9e331c3f0fb52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432710.808399:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bba416200/0xbcb9e331c3f0fb52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432710.808422:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bba416200/0xbcb9e331c3f0fb52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432710.808448:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba45d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812784384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787432710.808931:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432710.808978:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b99bff240 going to sleep for 11 seconds 00000100:00100000:2.0:1787432710.809106:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812784384 00000100:00100000:2.0:1787432710.809115:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812784384 00000100:00100000:2.0:1787432710.809163:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787432710.809173:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812784384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432710.809188:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432710.809202:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bbaa5f000/0xbcb9e331c3f0fb59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0fb52 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432710.809236:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bbaa5f000/0xbcb9e331c3f0fb59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fb52 expref: 19 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432710.809255:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bbaa5f000/0xbcb9e331c3f0fb59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fb52 expref: 19 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432710.809267:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f000, rc 0) 00000100:00100000:2.0:1787432710.809312:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812784384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432710.809328:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787432710.809631:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba45d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812784384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432710.809649:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bba416200/0xbcb9e331c3f0fb52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fb59 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432710.809770:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bba416200/0xbcb9e331c3f0fb52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fb59 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432710.809834:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba864a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812784512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432710.809865:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432710.809894:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9087de40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432710.810072:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812784512 00000100:00100000:2.0:1787432710.810077:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812784512 00000100:00100000:2.0:1787432710.810111:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787432710.810118:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812784512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432710.810640:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812784512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 518us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432710.810650:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787432710.810761:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba864a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812784512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432710.810795:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba864a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812784640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432710.810832:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432710.810887:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9087de40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432710.810918:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812784640 00000100:00100000:2.0:1787432710.810923:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812784640 00000100:00100000:2.0:1787432710.810993:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787432710.811001:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812784640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432710.811147:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812784640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432710.811154:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787432710.811209:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba864a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812784640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787432710.811890:0:11279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787432710.811940:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787432710.811956:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787432710.811964:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba416200/0xbcb9e331c3f0fb52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fb59 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432710.811975:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bba416200/0xbcb9e331c3f0fb52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fb59 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432711.285772:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432712.323124:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432713.334237:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432713.463389:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812784768:0@lo:400:kworker.0 00000100:00100000:1.0:1787432713.463466:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432713.463526:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba865500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812785280:0@lo:400:kworker.0 00000100:00100000:1.0:1787432713.463554:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432713.463582:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787432713.463588:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812785152:0@lo:400:kworker.0 00000100:00100000:1.0:1787432713.463614:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432713.463643:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba866a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812784896:0@lo:400:kworker.0 00000100:00100000:1.0:1787432713.463740:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432713.463762:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812785408:0@lo:400:kworker.0 00000100:00100000:1.0:1787432713.463780:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432713.463801:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432713.463806:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba865c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3332:1874258812785024:0@lo:400:kworker.0 00000100:00100000:1.0:1787432713.463825:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432713.463860:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812785280 00000100:00100000:1.0:1787432713.463872:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812785280 00000100:00100000:1.0:1787432713.463940:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812784896 00000100:00100000:1.0:1787432713.463944:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812784896 00000100:00100000:1.0:1787432713.463976:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812785024 00000100:00100000:1.0:1787432713.463979:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812785024 00000100:00100000:1.0:1787432713.463998:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787432713.464008:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812785280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432713.464064:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812785280:12345-0@lo:400:kworker.0 Request processed in 57us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432713.464070:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787432713.464089:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787432713.464095:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812784896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432713.464125:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812784896:12345-0@lo:400:kworker.0 Request processed in 31us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432713.464131:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787432713.464142:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787432713.464148:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1874258812785024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432713.464173:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1874258812785024:12345-0@lo:400:kworker.0 Request processed in 26us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432713.464178:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787432713.464197:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812785152 00000100:00100000:1.0:1787432713.464200:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812785152 00000100:00100000:1.0:1787432713.464225:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812785408 00000100:00100000:1.0:1787432713.464228:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812785408 00000100:00100000:1.0:1787432713.464244:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787432713.464249:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812785152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432713.464280:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812785152:12345-0@lo:400:kworker.0 Request processed in 31us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432713.464286:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787432713.464310:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787432713.464322:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812785408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432713.464351:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812785408:12345-0@lo:400:kworker.0 Request processed in 30us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432713.464357:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1787432713.464382:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432713.464386:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787432713.464388:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432713.464425:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba865c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3332:1874258812785024:0@lo:400:kworker.0 00000100:00100000:1.0:1787432713.464436:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba866a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812784896:0@lo:400:kworker.0 00010000:00080000:1.0:1787432713.464449:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bba867480 x1874258812785408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432713.464459:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812785408:0@lo:400:kworker.0 00010000:00080000:1.0:1787432713.464495:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bba865180 x1874258812785152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432713.464504:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812785152:0@lo:400:kworker.0 00000100:00100000:1.0:1787432713.464514:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba865500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812785280:0@lo:400:kworker.0 00000100:00100000:0.0:1787432713.464684:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812784768 00000100:00100000:0.0:1787432713.464688:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812784768 00000100:00100000:0.0:1787432713.464730:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787432713.464737:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3331:x1874258812784768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432713.464772:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3331:x1874258812784768:12345-0@lo:400:kworker.0 Request processed in 36us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432713.464778:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787432713.465457:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812784768:0@lo:400:kworker.0 00000001:02000400:0.0:1787432713.677375:0:11407:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787432713.978405:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812785536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432713.978510:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432713.978586:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812785536 00000100:00100000:2.0:1787432713.978595:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812785536 00000100:00100000:2.0:1787432713.978645:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787432713.978670:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812785536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432713.978708:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432713.978756:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812785536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432713.978763:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787432713.978803:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa52300 x1874258812785536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432713.978822:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812785536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432713.983387:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432713.983410:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812785664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432713.983479:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432713.984231:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812785664 00000100:00100000:3.0:1787432713.984240:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812785664 00000100:00100000:3.0:1787432713.984303:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787432713.984313:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812785664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787432713.984348:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787432713.984398:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812785664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432713.984405:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787432713.984456:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bba0a9500 x1874258812785664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432713.984476:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812785664:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787432714.361354:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432715.185888:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432715.186230:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791776128 00000100:00100000:0.0:1787432715.186292:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791776128 00000100:00100000:0.0:1787432715.186359:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 248 00000100:00100000:0.0:1787432715.186370:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2378:x1874258791776128:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432715.190353:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2378:x1874258791776128:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 3968us (4459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432715.190369:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 248 00000100:00100000:3.0:1787432715.193491:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432715.193584:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791776384 00000100:00100000:3.0:1787432715.193612:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432715.193635:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791776384 00000100:00100000:1.0:1787432715.193712:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791776256 00000100:00100000:1.0:1787432715.193716:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791776256 00000100:00080000:3.0:1787432715.193737:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432715.193745:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 99 00000100:00100000:1.0:1787432715.193757:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2378:x1874258791776384:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432715.193769:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 100 00000100:00100000:3.0:1787432715.193781:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+6:2378:x1874258791776256:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432715.193836:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2378:x1874258791776384:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 81us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432715.193858:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 99 00000100:00100000:3.0:1787432715.193889:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+6:2378:x1874258791776256:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 110us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432715.193896:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 100 00010000:00010000:0.0:1787432715.382058:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432716.406549:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432717.430091:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787432718.376030:0:11507:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 17:05:16 (1787432716) === 00010000:00010000:3.0:1787432718.463285:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432718.595115:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812785792:0@lo:400:kworker.0 00000100:00100000:3.0:1787432718.595214:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432718.595275:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812786304:0@lo:400:kworker.0 00000100:00100000:3.0:1787432718.595302:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432718.595344:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432718.595351:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812786176:0@lo:400:kworker.0 00000100:00100000:3.0:1787432718.595376:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432718.595406:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812785920:0@lo:400:kworker.0 00000100:00100000:3.0:1787432718.595428:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432718.595443:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb992b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812786432:0@lo:400:kworker.0 00000100:00100000:3.0:1787432718.595460:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432718.595490:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787432718.595496:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3332:1874258812786048:0@lo:400:kworker.0 00000100:00100000:3.0:1787432718.595518:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432718.595653:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812786304 00000100:00100000:3.0:1787432718.595684:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812786304 00000100:00100000:3.0:1787432718.595734:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812785920 00000100:00100000:3.0:1787432718.595738:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812785920 00000100:00100000:3.0:1787432718.595755:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812786048 00000100:00100000:3.0:1787432718.595759:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812786048 00000100:00100000:3.0:1787432718.595778:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787432718.595787:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812786304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432718.595845:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812786304:12345-0@lo:400:kworker.0 Request processed in 59us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432718.595852:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787432718.595868:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787432718.595874:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812785920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432718.595906:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812785920:12345-0@lo:400:kworker.0 Request processed in 32us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432718.595912:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787432718.595923:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787432718.595930:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1874258812786048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432718.595957:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1874258812786048:12345-0@lo:400:kworker.0 Request processed in 28us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432718.595963:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787432718.595982:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812785792 00000100:00100000:3.0:1787432718.595985:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812785792 00000100:00080000:3.0:1787432718.596187:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432718.596205:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787432718.596220:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3331:x1874258812785792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432718.596266:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3331:x1874258812785792:12345-0@lo:400:kworker.0 Request processed in 47us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432718.596272:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787432718.599890:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3332:1874258812786048:0@lo:400:kworker.0 00000100:00100000:3.0:1787432718.599908:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812785920:0@lo:400:kworker.0 00000100:00100000:3.0:1787432718.599945:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812785792:0@lo:400:kworker.0 00000100:00100000:3.0:1787432718.599957:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812786304:0@lo:400:kworker.0 00000100:00100000:1.0:1787432718.606977:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812786176 00000100:00100000:1.0:1787432718.606997:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812786176 00000100:00100000:1.0:1787432718.607072:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812786432 00000100:00100000:1.0:1787432718.607076:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812786432 00000100:00100000:1.0:1787432718.607106:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787432718.607117:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812786176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432718.607254:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812786176:12345-0@lo:400:kworker.0 Request processed in 122us (11859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432718.607262:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787432718.607282:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787432718.607288:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812786432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432718.607326:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812786432:12345-0@lo:400:kworker.0 Request processed in 39us (11865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432718.607333:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787432718.607403:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb992b800 x1874258812786432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432718.607419:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb992b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812786432:0@lo:400:kworker.0 00010000:00080000:1.0:1787432718.607456:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb9929f80 x1874258812786176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432718.607465:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812786176:0@lo:400:kworker.0 00000100:00080000:0.0:1787432718.614422:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787432718.614433:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432718.672729:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432718.672845:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791776512 00000100:00100000:3.0:1787432718.672854:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791776512 00000100:00100000:3.0:1787432718.672932:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:3.0:1787432718.672942:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+6:2378:x1874258791776512:12345-192.168.202.15@tcp:41:mkdir.0 00000004:00000024:3.0:1787432718.672992:0:5867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787432718.673133:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+6:2378:x1874258791776512:12345-192.168.202.15@tcp:41:mkdir.0 Request processed in 192us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432718.673142:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00080000:0.0:1787432718.673275:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432718.688164:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432718.688387:0:5876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791776640 00000100:00100000:3.0:1787432718.688397:0:5876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791776640 00000100:00100000:3.0:1787432718.688466:0:5876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:3.0:1787432718.688477:0:5876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ee8b542c-0113-490f-a721-62606ee0807f+6:9720:x1874258791776640:12345-192.168.202.15@tcp:700:mkdir.0 00000100:00100000:3.0:1787432718.688560:0:5876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ee8b542c-0113-490f-a721-62606ee0807f+6:9720:x1874258791776640:12345-192.168.202.15@tcp:700:mkdir.0 Request processed in 84us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432718.688568:0:5876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:2.0:1787432718.694149:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432718.694283:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791776896 00000100:00100000:1.0:1787432718.694293:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791776896 00000100:00100000:1.0:1787432718.694353:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:1.0:1787432718.694376:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+6:9720:x1874258791776896:12345-192.168.202.15@tcp:36:mkdir.0 00010000:00010000:1.0:1787432718.694430:0:5869:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432718.694501:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fa41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b12 expref: 6 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.694527:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a100) 00010000:00010000:1.0:1787432718.694562:0:5869:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787432718.698266:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f0fb60 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.698292:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f0fb60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.698305:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f0fb60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.698334:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fb67 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.698350:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fb67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.698359:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fb67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432718.699747:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787432718.699763:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f0fb60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.699773:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f0fb60 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.699781:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f0fb60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.699787:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031a00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432718.699792:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f0fb60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.699800:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f0fb60 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.699816:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9838fc00) 00010000:00010000:0.0:1787432718.699818:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432718.699823:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f0fb60 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.699829:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f0fb60 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787432718.699848:0:5869:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007fdcf3fe reply state 0000000009a1f196 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fb67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432718.699864:0:5869:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787432718.699979:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+7:9720:x1874258791776896:12345-192.168.202.15@tcp:36:mkdir.0 Request processed in 5600us (5836us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787432718.699988:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00010000:00010000:0.0:1787432718.702542:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fb67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.702557:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fb67 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.702565:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fb67 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.702571:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432718.702576:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fb67 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.702583:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fb67 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.702600:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff935b9838f800) 00010000:00010000:0.0:1787432718.702604:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432718.702608:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fb67 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.702614:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fb67 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432718.721951:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432718.722041:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791777024 00000100:00100000:1.0:1787432718.722051:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791777024 00000100:00100000:1.0:1787432718.722123:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:1.0:1787432718.722134:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:9721:x1874258791777024:12345-192.168.202.15@tcp:101:chmod.0 00010000:00010000:1.0:1787432718.722157:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432718.722183:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417e00/0xbcb9e331c3f0fb6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025b97 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.722278:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417400/0xbcb9e331c3f0fb75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.722294:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417400/0xbcb9e331c3f0fb75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.722305:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417400/0xbcb9e331c3f0fb75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432718.725499:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787432718.725511:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787432718.725582:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417400/0xbcb9e331c3f0fb75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.725627:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417e00/0xbcb9e331c3f0fb6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b97 expref: 8 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.725681:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417400/0xbcb9e331c3f0fb75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b97 expref: 7 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.725692:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935ba2a69400) 00010000:00010000:1.0:1787432718.725695:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787432718.725699:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba417400, rc 0) 00000100:00100000:1.0:1787432718.725836:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+7:9721:x1874258791777024:12345-192.168.202.15@tcp:101:chmod.0 Request processed in 3702us (3895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432718.725845:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:1.0:1787432718.730627:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432718.730808:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791777280 00000100:00100000:3.0:1787432718.730819:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791777280 00000100:00100000:3.0:1787432718.730880:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:3.0:1787432718.730890:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+7:9721:x1874258791777280:12345-192.168.202.15@tcp:36:chmod.0 00010000:00010000:3.0:1787432718.730946:0:8110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432718.730974:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417400/0xbcb9e331c3f0fb75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b97 expref: 7 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432718.730993:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935ba2a69400) 00010000:00010000:3.0:1787432718.731007:0:8110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432718.731033:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fb7c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432718.731047:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fb7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432718.731056:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fb7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432718.731514:0:8110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026a132be reply state 00000000df13460f transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fb7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432718.731524:0:8110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787432718.731539:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787432718.731722:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+8:9721:x1874258791777280:12345-192.168.202.15@tcp:36:chmod.0 Request processed in 831us (1105us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787432718.731730:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00010000:00010000:3.0:1787432718.736970:0:3317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fb7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432718.736988:0:3317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fb7c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432718.737010:0:3317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fb7c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432718.737016:0:3317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2167400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432718.737021:0:3317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fb7c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432718.737030:0:3317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fb7c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432718.737047:0:3317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a900) 00010000:00010000:3.0:1787432718.737051:0:3317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787432718.737055:0:3317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fb7c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432718.737062:0:3317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fb7c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432718.786422:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432718.786543:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791777408 00000100:00100000:0.0:1787432718.786555:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791777408 00000100:00100000:0.0:1787432718.786729:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:0.0:1787432718.786742:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+7:9722:x1874258791777408:12345-192.168.202.15@tcp:101:chown.0 00010000:00010000:0.0:1787432718.786769:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432718.786795:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f0fb83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025b9e expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.786883:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f0fb8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.786897:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f0fb8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.786908:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f0fb8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432718.786970:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787432718.786974:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787432718.787014:0:5869:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f0fb8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.787043:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f0fb83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b9e expref: 9 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.787063:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f0fb8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b9e expref: 8 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.787071:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9838f800) 00010000:00010000:0.0:1787432718.787074:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787432718.787078:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80031c00, rc 0) 00000100:00100000:0.0:1787432718.787152:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+8:9722:x1874258791777408:12345-192.168.202.15@tcp:101:chown.0 Request processed in 411us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432718.787233:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:2.0:1787432718.789924:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432718.790026:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791777536 00000100:00100000:1.0:1787432718.790036:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791777536 00000100:00100000:1.0:1787432718.790133:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:1.0:1787432718.790145:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+8:9722:x1874258791777536:12345-192.168.202.15@tcp:101:chown.0 00010000:00010000:1.0:1787432718.790166:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432718.790187:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417e00/0xbcb9e331c3f0fb91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025ba5 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790277:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417800/0xbcb9e331c3f0fb98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790293:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417800/0xbcb9e331c3f0fb98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790315:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417800/0xbcb9e331c3f0fb98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790348:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417400/0xbcb9e331c3f0fb9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790365:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417400/0xbcb9e331c3f0fb9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790373:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417400/0xbcb9e331c3f0fb9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790489:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fba6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790498:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790506:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432718.790558:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787432718.790561:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787432718.790589:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790602:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417800/0xbcb9e331c3f0fb98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790621:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417800/0xbcb9e331c3f0fb98 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790628:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417800/0xbcb9e331c3f0fb98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790643:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba417800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432718.790647:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417800/0xbcb9e331c3f0fb98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790654:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417800/0xbcb9e331c3f0fb98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790924:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9838f800) 00010000:00010000:1.0:1787432718.790927:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432718.790932:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417800/0xbcb9e331c3f0fb98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790938:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417800/0xbcb9e331c3f0fb98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790952:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417400/0xbcb9e331c3f0fb9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790958:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417400/0xbcb9e331c3f0fb9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790964:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417400/0xbcb9e331c3f0fb9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790970:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba417400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432718.790973:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417400/0xbcb9e331c3f0fb9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790979:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417400/0xbcb9e331c3f0fb9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.790998:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff935ba2a69300) 00010000:00010000:1.0:1787432718.791001:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432718.791004:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417400/0xbcb9e331c3f0fb9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.791011:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417400/0xbcb9e331c3f0fb9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.791048:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba417e00/0xbcb9e331c3f0fb91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ba5 expref: 10 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.791061:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ba5 expref: 9 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.791069:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff935ba2a69400) 00010000:00010000:1.0:1787432718.791071:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787432718.791073:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e6a00, rc 0) 00000100:00100000:1.0:1787432718.791145:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+9:9722:x1874258791777536:12345-192.168.202.15@tcp:101:chown.0 Request processed in 1001us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432718.791153:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:2.0:1787432718.794448:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432718.794651:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791777792 00000100:00100000:1.0:1787432718.794739:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791777792 00000100:00100000:1.0:1787432718.794843:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:1.0:1787432718.794854:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+9:9722:x1874258791777792:12345-192.168.202.15@tcp:36:chown.0 00010000:00010000:1.0:1787432718.794907:0:6929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432718.794935:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fba6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ba5 expref: 9 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.794973:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff935ba2a69400) 00010000:00010000:1.0:1787432718.794985:0:6929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432718.795011:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.795024:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.795033:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787432718.827504:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:0.0:1787432718.827521:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1787432718.827643:0:6929:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ca524c8 reply state 000000003883b2f1 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432718.827698:0:6929:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787432718.827855:0:6929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1787432718.827952:0:6929:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787432718.827972:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+7:9722:x1874258791777792:12345-192.168.202.15@tcp:36:chown.0 Request processed in 33115us (33528us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787432718.827981:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00010000:00010000:1.0:1787432718.828015:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.828025:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.828033:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.828038:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6e00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432718.828050:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.828057:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.828072:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff935ba2a69000) 00010000:00010000:1.0:1787432718.828075:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787432718.828080:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.828086:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432718.850883:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432718.851311:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791777920 00000100:00100000:0.0:1787432718.851324:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791777920 00000100:00100000:0.0:1787432718.851480:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:0.0:1787432718.851492:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+6:9723:x1874258791777920:12345-192.168.202.15@tcp:101:touch.500 00010000:00010000:0.0:1787432718.851517:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432718.851538:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f0fbb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025bac expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787432718.855791:0:5869:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4200us 00010000:00010000:1.0:1787432718.871862:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbbb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.871887:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.871900:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.871917:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fbc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.871923:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.871929:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.872630:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f0fbc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.872641:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f0fbc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.872650:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f0fbc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432718.873038:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787432718.873043:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787432718.873148:0:5869:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f0fbc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.873846:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.873857:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbbb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.873864:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbbb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.873870:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6e00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432718.873875:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbbb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.873883:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbbb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.873897:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9838f800) 00010000:00010000:1.0:1787432718.873908:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432718.873913:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.873919:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fbbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.873932:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.873938:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fbc2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.873944:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.873949:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6a00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432718.873952:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.873957:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fbc2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.873965:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff935ba2a69000) 00010000:00010000:1.0:1787432718.873968:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432718.873970:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fbc2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.873976:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fbc2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.874023:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f0fbb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bac expref: 8 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.874054:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f0fbc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bac expref: 7 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.874062:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff935ba2a69300) 00010000:00010000:1.0:1787432718.874064:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787432718.874067:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e7000, rc 0) 00000100:00100000:1.0:1787432718.874477:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+7:9723:x1874258791777920:12345-192.168.202.15@tcp:101:touch.500 Request processed in 22985us (23601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432718.874487:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:1.0:1787432718.881565:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432718.881689:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791778176 00000100:00100000:3.0:1787432718.881698:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791778176 00000100:00100000:3.0:1787432718.881751:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:3.0:1787432718.881760:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+7:9723:x1874258791778176:12345-192.168.202.15@tcp:101:touch.500 00010000:00010000:3.0:1787432718.881781:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432718.881801:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fbd0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025bb3 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432718.882092:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fbd7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432718.882105:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fbd7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432718.882120:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fbd7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432718.882163:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fbde lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432718.882171:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fbde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432718.882177:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fbde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787432718.883629:0:5868:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787432718.883925:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fbe5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.883940:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.883950:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.883981:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fbd7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.883988:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fbd7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.883994:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fbd7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.884009:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2166000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432718.884014:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fbd7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.884021:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fbd7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.884033:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff935ba2a69300) 00010000:00010000:0.0:1787432718.884036:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432718.884040:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fbd7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.884046:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fbd7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787432718.884058:0:5868:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001af8522e reply state 00000000b0c0e2f3 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fbde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432718.884067:0:5868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787432718.884099:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fbd0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bb3 expref: 10 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.884113:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fbe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bb3 expref: 9 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.884120:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff935b9838fc00) 00010000:00010000:0.0:1787432718.884122:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432718.884124:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80030000, rc 0) 00000100:00100000:0.0:1787432718.884513:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+10:9723:x1874258791778176:12345-192.168.202.15@tcp:101:touch.500 Request processed in 2752us (2954us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787432718.884528:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 22 00010000:00010000:1.0:1787432718.887003:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fbde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.887019:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fbde lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.887026:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fbde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.887031:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2166800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432718.887035:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fbde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.887041:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fbde lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.887057:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x5e6975f3 (ffff935b8304a900) 00010000:00010000:1.0:1787432718.887059:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432718.887077:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fbde lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.887083:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fbde lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432718.889211:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432718.889410:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791778432 00000100:00100000:2.0:1787432718.889420:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791778432 00000100:00100000:2.0:1787432718.889485:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:2.0:1787432718.889494:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+9:9723:x1874258791778432:12345-192.168.202.15@tcp:36:touch.500 00010000:00010000:2.0:1787432718.889548:0:6929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432718.889570:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fbe5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bb3 expref: 9 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432718.889596:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff935b9838fc00) 00010000:00010000:2.0:1787432718.889604:0:6929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432718.889642:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fbf3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432718.889653:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fbf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432718.889693:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fbf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432718.889803:0:6929:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034704597 reply state 000000002fb4766d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fbf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432718.889810:0:6929:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787432718.889883:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+10:9723:x1874258791778432:12345-192.168.202.15@tcp:36:touch.500 Request processed in 391us (680us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787432718.889888:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:0.0:1787432718.892258:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432718.892391:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791778560 00000100:00100000:2.0:1787432718.892399:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791778560 00000100:00100000:2.0:1787432718.892458:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:2.0:1787432718.892468:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+10:9723:x1874258791778560:12345-192.168.202.15@tcp:101:touch.500 00010000:00010000:2.0:1787432718.892491:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432718.892522:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0fbfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025bba expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432718.892580:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0fbfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bba expref: 11 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432718.892614:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0fbfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bba expref: 11 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432718.892635:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff935b952e8600) 00010000:00010000:2.0:1787432718.892638:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787432718.892641:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e800, rc 0) 00000100:00100000:2.0:1787432718.892718:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+11:9723:x1874258791778560:12345-192.168.202.15@tcp:101:touch.500 Request processed in 251us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432718.892725:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 24 00010000:00010000:1.0:1787432718.893044:0:3317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fbf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.893053:0:3317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fbf3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.893060:0:3317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fbf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.893066:0:3317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432718.893071:0:3317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fbf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.893078:0:3317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fbf3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.893090:0:3317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff935b952e8600) 00010000:00010000:1.0:1787432718.893092:0:3317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432718.893096:0:3317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fbf3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432718.893102:0:3317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fbf3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432718.897285:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432718.897535:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791778688 00000100:00100000:1.0:1787432718.897546:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791778688 00000100:00100000:1.0:1787432718.897616:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:1.0:1787432718.897625:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba865500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2374:x1874258791778688:12345-192.168.202.15@tcp:8:touch.500 00010000:00080000:1.0:1787432718.897684:0:8446:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp t0 exp 0000000000000000 cur 353 last 0 00000020:00000080:1.0:1787432718.897717:0:8446:0:(genops.c:1385:class_connect()) connect: client ee8b542c-0113-490f-a721-62606ee0807f, cookie 0xbcb9e331c3f0fc01 00002000:00100000:1.0:1787432718.897731:0:8446:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ee8b542c-0113-490f-a721-62606ee0807f/ffff935b98a87000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787432718.897756:0:8446:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787432718.897966:0:8446:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787432718.897992:0:8446:0:(import.c:65:import_set_state_nolock()) ffff935b87de8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787432718.898042:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba865500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:2374:x1874258791778688:12345-192.168.202.15@tcp:8:touch.500 Request processed in 419us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432718.898047:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:1.0:1787432718.901030:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432718.901115:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791778816 00000100:00100000:2.0:1787432718.901124:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791778816 00000100:00100000:2.0:1787432718.901198:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:2.0:1787432718.901207:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+6:0:x1874258791778816:12345-192.168.202.15@tcp:2:touch.500 00000100:00080000:0.0:1787432718.901543:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432718.926543:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+7:0:x1874258791778816:12345-192.168.202.15@tcp:2:touch.500 Request processed in 25326us (25514us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787432718.926559:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00000001:00100000:0.0:1787432718.926628:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ee8b542c-0113-490f-a721-62606ee0807f 00000001:00080000:0.0:1787432718.926643:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1787432718.935505:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432718.935628:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791779072 00000100:00100000:1.0:1787432718.935639:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791779072 00000100:00100000:1.0:1787432718.935710:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:1.0:1787432718.935722:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+10:9723:x1874258791779072:12345-192.168.202.15@tcp:35:touch.500 00000100:00100000:1.0:1787432718.936075:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+11:9723:x1874258791779072:12345-192.168.202.15@tcp:35:touch.500 Request processed in 354us (580us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787432718.936083:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:2.0:1787432718.957451:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432718.957772:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791779200 00000100:00100000:0.0:1787432718.957782:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791779200 00000100:00100000:0.0:1787432718.957845:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:0.0:1787432718.957856:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+11:9724:x1874258791779200:12345-192.168.202.15@tcp:101:rm.0 00010000:00010000:0.0:1787432718.957881:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432718.957907:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f0fc08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025bc1 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.957979:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fc0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.957993:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fc0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.958005:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fc0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432718.958062:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787432718.958066:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787432718.958106:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fc0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.958151:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f0fc08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bc1 expref: 13 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.958170:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fc0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bc1 expref: 12 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432718.958178:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff935ba2a69300) 00010000:00010000:0.0:1787432718.958180:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787432718.958184:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80030000, rc 0) 00000100:00100000:0.0:1787432718.958258:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+12:9724:x1874258791779200:12345-192.168.202.15@tcp:101:rm.0 Request processed in 404us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432718.958266:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:3.0:1787432719.005627:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432719.006082:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791779456 00000100:00100000:1.0:1787432719.006094:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791779456 00000100:00100000:1.0:1787432719.006173:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:1.0:1787432719.006185:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+12:9724:x1874258791779456:12345-192.168.202.15@tcp:101:rm.0 00010000:00010000:1.0:1787432719.006206:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432719.006237:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fc16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025bc8 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432719.006381:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787432719.006503:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fc16 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bc8 expref: 14 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.006520:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9838f800) 00010000:00010000:1.0:1787432719.006522:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787432719.006527:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fc16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bc8 expref: 14 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.006540:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e6e00, rc 0) 00000100:00100000:1.0:1787432719.006606:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+13:9724:x1874258791779456:12345-192.168.202.15@tcp:101:rm.0 Request processed in 424us (989us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1787432719.006612:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:2.0:1787432719.013425:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432719.013506:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791779584 00000100:00100000:1.0:1787432719.013515:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791779584 00000100:00100000:1.0:1787432719.013578:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:1.0:1787432719.013588:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+13:9724:x1874258791779584:12345-192.168.202.15@tcp:37:rm.0 00000100:00100000:1.0:1787432719.038815:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+13:9724:x1874258791779584:12345-192.168.202.15@tcp:37:rm.0 Request processed in 25216us (25389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432719.038829:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:3.0:1787432719.043939:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432719.044004:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791779840 00000100:00100000:2.0:1787432719.044017:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791779840 00000100:00100000:2.0:1787432719.044078:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:2.0:1787432719.044088:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b835a2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+13:9724:x1874258791779840:12345-192.168.202.15@tcp:35:rm.0 00000100:00100000:2.0:1787432719.044516:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b835a2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+14:9724:x1874258791779840:12345-192.168.202.15@tcp:35:rm.0 Request processed in 427us (585us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787432719.044524:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:2.0:1787432719.051854:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432719.052062:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791780096 00000100:00100000:3.0:1787432719.052072:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791780096 00000100:00100000:3.0:1787432719.052134:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:3.0:1787432719.052145:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+14:9724:x1874258791780096:12345-192.168.202.15@tcp:101:rm.0 00010000:00010000:3.0:1787432719.052180:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432719.052204:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167a00/0xbcb9e331c3f0fc24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025bcf expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.052338:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fc2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.052354:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fc2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.052378:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fc2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432719.052391:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787432719.052564:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167a00/0xbcb9e331c3f0fc24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bcf expref: 17 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.052583:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fc2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bcf expref: 16 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.052591:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff935ba2a69300) 00010000:00010000:3.0:1787432719.052594:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787432719.052598:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2167200, rc 0) 00000100:00100000:3.0:1787432719.052731:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+16:9724:x1874258791780096:12345-192.168.202.15@tcp:101:rm.0 Request processed in 586us (886us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787432719.052738:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:0.0:1787432719.064882:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432719.064988:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791780224 00000100:00100000:1.0:1787432719.064998:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791780224 00000100:00100000:1.0:1787432719.065059:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:1.0:1787432719.065069:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+16:9724:x1874258791780224:12345-192.168.202.15@tcp:41:rm.0 00000004:00000024:1.0:1787432719.065131:0:5868:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1787432719.065227:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+16:9724:x1874258791780224:12345-192.168.202.15@tcp:41:rm.0 Request processed in 158us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432719.065235:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:1.0:1787432719.076174:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432719.076285:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791780352 00000100:00100000:2.0:1787432719.076306:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791780352 00000100:00100000:2.0:1787432719.076381:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:2.0:1787432719.076392:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+16:9724:x1874258791780352:12345-192.168.202.15@tcp:101:rm.0 00010000:00010000:2.0:1787432719.076413:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432719.076433:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fc39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025bd6 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076499:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fc40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076514:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fc40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076525:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fc40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076539:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f0fc47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076545:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f0fc47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076552:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f0fc47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076701:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f0fc4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076710:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f0fc4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076717:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f0fc4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432719.076753:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787432719.076757:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787432719.076772:0:5869:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f0fc4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076783:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f0fc4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076790:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fc40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076796:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fc40 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076802:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fc40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076807:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432719.076811:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fc40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076819:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fc40 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076831:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff935ba2a69300) 00010000:00010000:2.0:1787432719.076833:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432719.076838:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fc40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076844:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fc40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076869:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f0fc47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076875:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f0fc47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076880:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f0fc47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076884:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fc00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432719.076887:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f0fc47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076908:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f0fc47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076916:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x5e6975f3 (ffff935b952e8900) 00010000:00010000:2.0:1787432719.076918:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432719.076921:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f0fc47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076926:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f0fc47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076955:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fc39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bd6 expref: 18 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076966:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f0fc4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bd6 expref: 17 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.076982:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff935b952e8600) 00010000:00010000:2.0:1787432719.076985:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432719.076987:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5ec00, rc 0) 00000100:00100000:2.0:1787432719.077041:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+17:9724:x1874258791780352:12345-192.168.202.15@tcp:101:rm.0 Request processed in 651us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432719.077048:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:2.0:1787432719.082104:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432719.082426:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791780608 00000100:00100000:1.0:1787432719.082437:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791780608 00000100:00100000:1.0:1787432719.082500:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:1.0:1787432719.082518:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+17:9724:x1874258791780608:12345-192.168.202.15@tcp:36:rm.0 00010000:00010000:1.0:1787432719.082574:0:6929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787432719.082600:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f0fc4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bd6 expref: 17 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.082621:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0fbfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bba expref: 16 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.082632:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff935b952e8600) 00010000:00010000:1.0:1787432719.082646:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fc0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bc1 expref: 15 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.082699:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff935ba2a69300) 00010000:00010000:1.0:1787432719.082703:0:6929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432719.082725:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f0fc55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.082739:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f0fc55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.082750:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f0fc55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.082779:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f0fc5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.082786:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f0fc5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.082792:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f0fc5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.083402:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f0fc63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.083413:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f0fc63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.083420:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f0fc63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787432719.088876:0:6929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1787432719.088903:0:6929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 353754245026ns, next at 354754230848ns, rc = 0 00010000:00010000:1.0:1787432719.088977:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fc6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.088996:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fc6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.089007:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fc6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.089016:0:6929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fc6a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.089035:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fc6a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.089041:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fc6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.089064:0:6929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432719.089087:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f0fc63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.089093:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f0fc63 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.089100:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f0fc63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.089106:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e7200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432719.089110:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f0fc63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.089118:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f0fc63 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.089131:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff935ba2a69000) 00010000:00010000:1.0:1787432719.089134:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787432719.089138:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f0fc63 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.089144:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f0fc63 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.089163:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f0fc55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.089174:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f0fc55 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.089180:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f0fc55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.089185:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432719.089189:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f0fc55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.089195:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f0fc55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.089203:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff935ba2a69300) 00010000:00010000:1.0:1787432719.089205:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432719.089208:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f0fc55 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.089213:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f0fc55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787432719.089223:0:6929:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a74874f reply state 000000007e9d8c23 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f0fc5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432719.089232:0:6929:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787432719.089338:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+16:9724:x1874258791780608:12345-192.168.202.15@tcp:36:rm.0 Request processed in 6826us (7241us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787432719.089347:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 30 00010000:00010000:0.0:1787432719.089706:0:11210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432719.089715:0:11210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fc6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432719.089722:0:11210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e7c00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:0.0:1787432719.089725:0:11210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fc6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432719.089732:0:11210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fc6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432719.089740:0:11210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff935ba2a69000) 00010000:00010000:0.0:1787432719.089742:0:11210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787432719.089746:0:11210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fc6a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432719.089763:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fc6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432719.089784:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432719.089786:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432719.089787:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432719.093617:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f0fc5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.093692:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f0fc5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.093702:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f0fc5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.093707:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432719.093713:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f0fc5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.093721:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f0fc5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.093738:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x5e6975f3 (ffff935ba2a69400) 00010000:00010000:1.0:1787432719.093741:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432719.093746:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f0fc5c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432719.093753:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f0fc5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x5e6975f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432719.094426:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812786560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432719.094483:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432719.094628:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432719.094638:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b98b1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812786688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432719.094693:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432719.094725:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812786560 00000100:00100000:2.0:1787432719.094732:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812786560 00000100:00100000:2.0:1787432719.094770:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812786688 00000100:00100000:2.0:1787432719.094773:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812786688 00000100:00100000:2.0:1787432719.094789:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787432719.094797:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba866a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812786560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432719.094833:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432719.094878:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba866a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812786560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432719.094885:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787432719.094914:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787432719.094921:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812786688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432719.094948:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432719.094982:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812786688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432719.094996:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1787432719.095030:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935b98b1a300 x1874258812786688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432719.095048:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b98b1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812786688:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787432719.095086:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb9929f80 x1874258812786560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432719.095096:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812786560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432719.101750:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432719.102598:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791780864 00000100:00100000:1.0:1787432719.102610:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791780864 00000100:00100000:1.0:1787432719.102688:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:1.0:1787432719.102699:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+15:9724:x1874258791780864:12345-192.168.202.15@tcp:35:rm.0 00000100:00100000:1.0:1787432719.102990:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+16:9724:x1874258791780864:12345-192.168.202.15@tcp:35:rm.0 Request processed in 292us (1254us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787432719.102998:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:0.0:1787432719.111765:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432719.111908:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791781120 00000100:00100000:3.0:1787432719.111919:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791781120 00000100:00100000:3.0:1787432719.111974:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:3.0:1787432719.111984:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+16:9724:x1874258791781120:12345-192.168.202.15@tcp:36:rm.0 00010000:00010000:3.0:1787432719.112050:0:8110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787432719.112079:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fc2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bcf expref: 16 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.112101:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f0fbc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bac expref: 15 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.112134:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff935ba2a69300) 00010000:00010000:3.0:1787432719.112167:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f0fb8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b9e expref: 14 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.112179:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9838f800) 00010000:00010000:3.0:1787432719.112185:0:8110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432719.112210:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167a00/0xbcb9e331c3f0fc71 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.112223:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167a00/0xbcb9e331c3f0fc71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.112251:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167a00/0xbcb9e331c3f0fc71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.112265:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fc78 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.112273:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fc78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.112279:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fc78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.112718:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fc7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.112729:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fc7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.112746:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fc7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432719.116138:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787432719.116177:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fc7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.116188:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fc7f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.116196:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fc7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.116202:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2167400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432719.116207:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fc7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.116215:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fc7f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.116417:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff935b8304a400) 00010000:00010000:3.0:1787432719.116421:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787432719.116425:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fc7f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.116432:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fc7f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.116463:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167a00/0xbcb9e331c3f0fc71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.116468:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167a00/0xbcb9e331c3f0fc71 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.116485:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167a00/0xbcb9e331c3f0fc71 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.116491:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2167a00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432719.116493:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167a00/0xbcb9e331c3f0fc71 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.116499:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167a00/0xbcb9e331c3f0fc71 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.116507:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304af00) 00010000:00010000:3.0:1787432719.116972:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432719.116978:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167a00/0xbcb9e331c3f0fc71 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.116985:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167a00/0xbcb9e331c3f0fc71 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432719.117003:0:8110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f6117a2 reply state 00000000fa3320a5 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fc78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432719.117012:0:8110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787432719.117203:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+15:9724:x1874258791781120:12345-192.168.202.15@tcp:36:rm.0 Request processed in 5215us (5445us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787432719.117213:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 31 00010000:00010000:3.0:1787432719.131308:0:3317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fc78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.131329:0:3317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fc78 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.131362:0:3317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fc78 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.131369:0:3317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2166800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432719.131374:0:3317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fc78 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.131382:0:3317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fc78 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.131400:0:3317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff935b8304ae00) 00010000:00010000:3.0:1787432719.131404:0:3317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432719.131408:0:3317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fc78 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432719.131414:0:3317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166800/0xbcb9e331c3f0fc78 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432719.477843:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432720.302880:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432720.303031:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432720.303195:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432720.303252:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432720.303279:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791781248 00000100:00100000:0.0:1787432720.303290:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791781248 00000100:00100000:1.0:1787432720.303313:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791781504 00000100:00100000:1.0:1787432720.303339:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791781504 00000100:00100000:0.0:1787432720.303358:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 250 00000100:00100000:0.0:1787432720.303371:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2378:x1874258791781248:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432720.303405:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 58 00000100:00100000:1.0:1787432720.303415:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2378:x1874258791781504:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432720.303446:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2378:x1874258791781248:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 77us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432720.303454:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 250 00000100:00100000:1.0:1787432720.303467:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2378:x1874258791781504:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 51us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432720.303477:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 58 00000100:00080000:1.0:1787432720.303508:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432720.304548:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791781376 00000100:00100000:3.0:1787432720.304559:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791781376 00000100:00100000:3.0:1787432720.304679:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791781632 00000100:00100000:3.0:1787432720.304682:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791781632 00000100:00080000:0.0:1787432720.304721:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432720.304817:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 104 00000100:00100000:3.0:1787432720.304826:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+14:2378:x1874258791781376:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432720.304894:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+14:2378:x1874258791781376:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 69us (2027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432720.304901:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 104 00000100:00100000:3.0:1787432720.304916:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 105 00000100:00100000:3.0:1787432720.304922:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2378:x1874258791781632:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432720.304961:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2378:x1874258791781632:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 39us (1931us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432720.304967:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 105 00010000:00010000:3.0:1787432720.501916:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432721.526225:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432722.550426:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432723.575356:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432723.701944:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812787072:0@lo:400:kworker.0 00000100:00100000:2.0:1787432723.702024:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432723.702085:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787432723.702092:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812786944:0@lo:400:kworker.0 00000100:00100000:2.0:1787432723.702151:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432723.702174:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812787456:0@lo:400:kworker.0 00000100:00100000:2.0:1787432723.702209:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432723.702241:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812787072 00000100:00100000:2.0:1787432723.702249:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812787072 00000100:00100000:2.0:1787432723.702302:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812786944 00000100:00100000:2.0:1787432723.702305:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812786944 00000100:00100000:2.0:1787432723.702328:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787432723.702338:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812787072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432723.702392:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812787072:12345-0@lo:400:kworker.0 Request processed in 55us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432723.702409:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787432723.702425:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787432723.702430:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812786944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432723.702456:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812786944:12345-0@lo:400:kworker.0 Request processed in 26us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432723.702460:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:2.0:1787432723.702479:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432723.702511:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812786944:0@lo:400:kworker.0 00000100:00100000:2.0:1787432723.702520:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812787072:0@lo:400:kworker.0 00000100:00100000:1.0:1787432723.702639:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812787200:0@lo:400:kworker.0 00000100:00100000:1.0:1787432723.702699:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432723.702725:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787432723.702732:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812786816:0@lo:400:kworker.0 00000100:00100000:1.0:1787432723.702759:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432723.702784:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812787328:0@lo:400:kworker.0 00000100:00100000:1.0:1787432723.702808:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432723.702840:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812787456 00000100:00100000:1.0:1787432723.702844:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812787456 00000100:00100000:1.0:1787432723.702878:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812787200 00000100:00100000:1.0:1787432723.702881:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812787200 00000100:00100000:1.0:1787432723.702900:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787432723.702906:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812787456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432723.702943:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812787456:12345-0@lo:400:kworker.0 Request processed in 37us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432723.702949:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787432723.702962:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787432723.702968:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812787200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432723.702998:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812787200:12345-0@lo:400:kworker.0 Request processed in 31us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432723.703011:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787432723.703031:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812786816 00000100:00100000:1.0:1787432723.703034:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812786816 00000100:00100000:1.0:1787432723.703060:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787432723.703066:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812786816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432723.703096:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812786816:12345-0@lo:400:kworker.0 Request processed in 30us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432723.703102:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787432723.703137:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812787328 00000100:00100000:1.0:1787432723.703141:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812787328 00000100:00100000:1.0:1787432723.703165:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787432723.703172:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812787328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432723.703214:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812787328:12345-0@lo:400:kworker.0 Request processed in 42us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432723.703220:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1787432723.703243:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787432723.703246:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787432723.703247:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432723.703264:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812786816:0@lo:400:kworker.0 00000100:00100000:1.0:1787432723.703274:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812787328:0@lo:400:kworker.0 00010000:00080000:1.0:1787432723.703283:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbae5aa00 x1874258812787200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432723.703293:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812787200:0@lo:400:kworker.0 00010000:00080000:1.0:1787432723.703321:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbae59f80 x1874258812787456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432723.703342:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812787456:0@lo:400:kworker.0 00000001:02000400:2.0:1787432723.994192:0:11658:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:2.0:1787432724.213930:0:8108:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358879270545ns, next at 359879267899ns, rc = 0 00000100:00100000:0.0:1787432724.214064:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432724.214087:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812787712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432724.217459:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432724.218962:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812787712 00000100:00100000:3.0:1787432724.218976:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812787712 00000100:00100000:3.0:1787432724.219036:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787432724.219048:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812787712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432724.219084:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787432724.219163:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812787712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432724.219170:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1787432724.220887:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bba865180 x1874258812787712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432724.220914:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812787712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432724.225783:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812787584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432724.225861:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432724.231564:0:9985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812787584 00000100:00100000:3.0:1787432724.231581:0:9985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812787584 00000100:00100000:3.0:1787432724.231653:0:9985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787432724.231682:0:9985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812787584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787432724.231716:0:9985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787432724.231812:0:9985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812787584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (5951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432724.231819:0:9985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1787432724.242184:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb9fd0a80 x1874258812787584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432724.242224:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812787584:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787432724.323841:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967300 is committed 00000001:00080000:1.0:1787432724.323858:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:1.0:1787432724.323864:0:5889:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787432724.323893:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:3.0:1787432724.324366:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812787840:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787432724.324449:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432724.324567:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812787840 00000100:00100000:1.0:1787432724.324575:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812787840 00000100:00100000:1.0:1787432724.324648:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787432724.324686:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb992b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812787840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787432724.324716:0:6725:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1787432724.324760:0:6725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8a0f0f, atime: 0x6a8a0f0f, ctime: 0x6a8a0f0f, blocks: 0x1 00010000:00010000:1.0:1787432724.324769:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053e7e74d/0xbcb9e331c3f0fc86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432724.324787:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=358s v=(0 0) 00010000:00010000:1.0:1787432724.324792:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432724.324799:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053e7e74d/0xbcb9e331c3f0fc86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432724.324816:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053e7e74d/0xbcb9e331c3f0fc86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432724.324836:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053e7e74d/0xbcb9e331c3f0fc86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432724.324843:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053e7e74d/0xbcb9e331c3f0fc86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432724.324861:0:6725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787432724.326074:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb992b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3331:x1874258812787840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1410us (1618us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787432724.326086:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787432724.326132:0:11210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432724.326141:0:11210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053e7e74d/0xbcb9e331c3f0fc86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432724.326151:0:11210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6200 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432724.326156:0:11210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053e7e74d/0xbcb9e331c3f0fc86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432724.326166:0:11210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053e7e74d/0xbcb9e331c3f0fc86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432724.326185:0:11210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053e7e74d/0xbcb9e331c3f0fc86 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432724.326203:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053e7e74d/0xbcb9e331c3f0fc86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432724.326242:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432724.326244:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432724.326246:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787432724.326419:0:3331:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff935bb9a96a00/2, rc 0, transno 4294967300 00000100:00100000:3.0:1787432724.326427:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812787840:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787432724.598906:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787432725.350837:0:11706:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe84bd07d0 20000000:00000080:1.0:1787432725.350861:0:11706:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff935b94181800 uarg=0000000000000000 20000000:01000000:1.0:1787432725.350909:0:11706:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787432725.350918:0:11706:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787432725.350925:0:11706:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1787432725.355858:0:11707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787432725.355954:0:11706:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787432725.366481:0:11706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787432725.366538:0:11706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787432725.366598:0:11706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787432725.366619:0:11706:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787432725.366639:0:11706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff935bbaa5e600/0xbcb9e331c3f0fc8d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.366687:0:11706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b89 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.366697:0:11706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bba417200/0xbcb9e331c3f0fb2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b90 expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.366705:0:11706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bba417600/0xbcb9e331c3f0fb3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fb36 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.366725:0:11706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bba417a00/0xbcb9e331c3f0fb4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fb44 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.366733:0:11706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bbaa5f000/0xbcb9e331c3f0fb59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fb52 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.366741:0:11706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff935bbaa5e600/0xbcb9e331c3f0fc8d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.366782:0:11706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bbaa5f000/0xbcb9e331c3f0fb59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0fb52 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.366798:0:11706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bbaa5f000/0xbcb9e331c3f0fb59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0fb52 expref: 18 pid: 5860 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432725.366814:0:11706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11706:1874258812787968:0@lo:104: 00000100:00100000:2.0:1787432725.366878:0:11706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432725.366933:0:11706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bba417a00/0xbcb9e331c3f0fb4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0fb44 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.366942:0:11706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bba417a00/0xbcb9e331c3f0fb4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0fb44 expref: 18 pid: 5860 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432725.366951:0:11706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11706:1874258812788096:0@lo:104: 00000100:00100000:2.0:1787432725.366973:0:11706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432725.367005:0:11706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bba417600/0xbcb9e331c3f0fb3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f0fb36 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.367013:0:11706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff935bba417600/0xbcb9e331c3f0fb3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f0fb36 expref: 18 pid: 5860 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432725.367028:0:11706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11706:1874258812788224:0@lo:104: 00000100:00100000:2.0:1787432725.367052:0:11706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432725.367069:0:11706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bba417200/0xbcb9e331c3f0fb2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b90 expref: 12 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.367080:0:11706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff935bba417200/0xbcb9e331c3f0fb2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b90 expref: 12 pid: 5860 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432725.367089:0:11706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11706:1874258812788352:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787432725.367149:0:11706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b89 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.367157:0:11706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b89 expref: 12 pid: 5862 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432725.367166:0:11706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11706:1874258812788480:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432725.367201:0:11706:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb7d8f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432725.367461:0:5850:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787432725.367475:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812787968 00000100:00100000:0.0:1787432725.367481:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812787968 00000100:00100000:0.0:1787432725.367521:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812788096 00000100:00100000:0.0:1787432725.367524:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812788096 00000100:00100000:0.0:1787432725.367535:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812788224 00000100:00100000:0.0:1787432725.367538:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812788224 00000100:00100000:0.0:1787432725.367552:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787432725.367562:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+5:11706:x1874258812787968:12345-0@lo:104: 00010000:00010000:0.0:1787432725.367574:0:5850:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bba416200/0xbcb9e331c3f0fb52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0fb59 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.367640:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787432725.367646:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+5:11706:x1874258812787968:12345-0@lo:104: Request processed in 87us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432725.367652:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787432725.367692:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787432725.367698:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+4:11706:x1874258812788096:12345-0@lo:104: 00010000:00010000:0.0:1787432725.367705:0:5850:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0fb44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0fb4b expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.367736:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787432725.367741:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+4:11706:x1874258812788096:12345-0@lo:104: Request processed in 44us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432725.367747:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787432725.367758:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787432725.367763:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b90701050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+3:11706:x1874258812788224:12345-0@lo:104: 00010000:00010000:0.0:1787432725.367776:0:5850:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0fb36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0fb3d expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.367806:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787432725.367811:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b90701050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+3:11706:x1874258812788224:12345-0@lo:104: Request processed in 48us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432725.367816:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1787432725.367854:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787432725.367860:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bba416200/0xbcb9e331c3f0fb52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0fb59 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.367867:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba416200 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:0.0:1787432725.367871:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bba416200/0xbcb9e331c3f0fb52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0fb59 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.367880:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bba416200/0xbcb9e331c3f0fb52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0fb59 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432725.367888:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bba416200/0xbcb9e331c3f0fb52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0fb59 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432725.367894:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787432725.367919:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bba416200/0xbcb9e331c3f0fb52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0fb59 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.367926:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432725.367942:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bba416200/0xbcb9e331c3f0fb52 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0fb59 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.367949:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bba416200/0xbcb9e331c3f0fb52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0fb59 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.367968:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787432725.367972:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0fb44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0fb4b expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.367978:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030c00 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:0.0:1787432725.367981:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0fb44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0fb4b expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.367988:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0fb44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0fb4b expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432725.367995:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0fb44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0fb4b expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432725.368000:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787432725.368013:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0fb44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0fb4b expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.368020:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432725.368026:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0fb44 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0fb4b expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.368033:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935b80030c00/0xbcb9e331c3f0fb44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0fb4b expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.368043:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432725.368046:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0fb36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f0fb3d expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.368062:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031400 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:0.0:1787432725.368065:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0fb36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f0fb3d expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.368072:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0fb36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f0fb3d expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432725.368079:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0fb36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f0fb3d expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432725.368084:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787432725.368222:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0fb36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0fb3d expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.368230:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432725.368247:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0fb36 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0fb3d expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.368253:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935b80031400/0xbcb9e331c3f0fb36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f0fb3d expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.368268:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432725.368270:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432725.368272:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432725.368279:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432725.368298:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812788864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432725.368330:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432725.368365:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812788864 00000100:00100000:0.0:1787432725.368370:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812788864 00010000:00010000:0.0:1787432725.368395:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bba417600/0xbcb9e331c3f0fb3d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0fb36 expref: 19 pid: 5860 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432725.368416:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787432725.368423:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812788864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432725.368432:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432725.368487:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bba417600/0xbcb9e331c3f0fb3d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0fb36 expref: 19 pid: 5860 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.368497:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bba417600/0xbcb9e331c3f0fb3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0fb36 expref: 19 pid: 5860 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.368511:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432725.368540:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812788864:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432725.368547:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787432725.368593:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812788864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432725.368710:0:11706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11706:1874258812787968:0@lo:104: 00000100:00100000:2.0:1787432725.368720:0:11706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11706:1874258812788096:0@lo:104: 00010000:00010000:2.0:1787432725.368728:0:11706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bba417600/0xbcb9e331c3f0fb3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0fb36 expref: 18 pid: 5860 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432725.368738:0:11706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11706:1874258812788224:0@lo:104: 00010000:00010000:1.0:1787432725.370686:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432725.370726:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812788608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432725.370805:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432725.370865:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432725.370872:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812788736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432725.370903:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432725.370952:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812788608 00000100:00100000:1.0:1787432725.370962:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812788608 00010000:00010000:1.0:1787432725.371009:0:8489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bbaa5f000/0xbcb9e331c3f0fb59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0fb52 expref: 18 pid: 5860 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432725.371060:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812788736 00000100:00100000:1.0:1787432725.371065:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812788736 00010000:00010000:1.0:1787432725.371078:0:8489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bba417a00/0xbcb9e331c3f0fb4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0fb44 expref: 19 pid: 5860 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432725.371084:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787432725.371203:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3332:x1874258812788608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432725.371226:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432725.371238:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bbaa5f000/0xbcb9e331c3f0fb59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0fb52 expref: 19 pid: 5860 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.371258:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bbaa5f000/0xbcb9e331c3f0fb59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0fb52 expref: 19 pid: 5860 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.371282:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bbaa5f000/0xbcb9e331c3f0fb59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0fb52 expref: 19 pid: 5860 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432725.371322:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432725.371416:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:3332:x1874258812788608:12345-0@lo:103:ldlm_bl.0 Request processed in 237us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432725.371487:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812788608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432725.373892:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787432725.373922:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935ba07d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:3332:x1874258812788736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432725.373968:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432725.373980:0:8489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bba417a00/0xbcb9e331c3f0fb4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f0fb44 expref: 18 pid: 5860 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432725.374000:0:8489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bba417a00/0xbcb9e331c3f0fb4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f0fb44 expref: 18 pid: 5860 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432725.374024:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bba417a00/0xbcb9e331c3f0fb4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f0fb44 expref: 18 pid: 5860 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432725.374043:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432725.374143:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935ba07d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:3332:x1874258812788736:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (3239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432725.374152:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787432725.374247:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812788736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432725.378579:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787432725.380841:0:11706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11706:1874258812788352:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787432725.381067:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432725.381172:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432725.381223:0:11706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11706:1874258812788480:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787432725.381274:0:11706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff935bbaa5e600/0xbcb9e331c3f0fc8d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432725.381381:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791781760 00000100:00100000:2.0:1787432725.381410:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791781760 00010000:00010000:2.0:1787432725.381457:0:8489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bba417200/0xbcb9e331c3f0fb2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b90 expref: 13 pid: 5860 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432725.381499:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791781888 00000100:00100000:2.0:1787432725.381503:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791781888 00010000:00010000:2.0:1787432725.381516:0:8489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b89 expref: 14 pid: 5862 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432725.381544:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:2.0:1787432725.381555:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+14:2376:x1874258791781760:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432725.381573:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432725.381579:0:8489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bba417200/0xbcb9e331c3f0fb2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b90 expref: 14 pid: 5860 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.381592:0:8489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bba417200/0xbcb9e331c3f0fb2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b90 expref: 14 pid: 5860 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.381613:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bba417200/0xbcb9e331c3f0fb2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b90 expref: 14 pid: 5860 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.381632:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432725.381734:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2376:x1874258791781760:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 179us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432725.381741:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:2.0:1787432725.381760:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:2.0:1787432725.381767:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:2376:x1874258791781888:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432725.381775:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432725.381780:0:8489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b89 expref: 12 pid: 5862 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.381796:0:8489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b89 expref: 12 pid: 5862 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.381807:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bba417c00/0xbcb9e331c3f0fb28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025b89 expref: 12 pid: 5862 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.381819:0:8489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff935bbaa5e600/0xbcb9e331c3f0fc8d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.381827:0:8489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bbaa5e600/0xbcb9e331c3f0fc8d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.381843:0:8489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935bbaa5e600/0xbcb9e331c3f0fc8d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.381852:0:8489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935bbaa5e600/0xbcb9e331c3f0fc8d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.381860:0:8489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff935bbaa5e600/0xbcb9e331c3f0fc8d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.381867:0:8489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff935bbaa5e600/0xbcb9e331c3f0fc8d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.381874:0:8489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e600 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432725.381879:0:8489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff935bbaa5e600/0xbcb9e331c3f0fc8d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.381889:0:8489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff935bbaa5e600/0xbcb9e331c3f0fc8d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.381912:0:8489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff935bbaa5e600/0xbcb9e331c3f0fc8d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432725.381922:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432725.381944:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+11:2376:x1874258791781888:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 177us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432725.381950:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 34 00010000:00010000:1.0:1787432725.382154:0:11706:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff935bbaa5e600/0xbcb9e331c3f0fc8d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432725.382163:0:11706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff935bbaa5e600/0xbcb9e331c3f0fc8d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432725.382169:0:11706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bbaa5e600/0xbcb9e331c3f0fc8d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432725.423310:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432725.423361:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432725.423456:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432725.423496:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791782016 00000100:00100000:1.0:1787432725.423509:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791782016 00000100:00100000:1.0:1787432725.423587:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791782272 00000100:00100000:1.0:1787432725.423590:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791782272 00000100:00100000:1.0:1787432725.423618:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 109 00000100:00100000:1.0:1787432725.423631:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+5:2377:x1874258791782016:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432725.423753:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+5:2377:x1874258791782016:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 124us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432725.423762:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 109 00000100:00100000:1.0:1787432725.423783:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 110 00000100:00100000:1.0:1787432725.423789:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2377:x1874258791782272:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432725.423814:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2377:x1874258791782272:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 25us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432725.423819:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 110 00000100:00100000:1.0:1787432725.423840:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791782144 00000100:00100000:1.0:1787432725.423845:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791782144 00000100:00100000:1.0:1787432725.423879:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:1.0:1787432725.423885:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8b542c-0113-490f-a721-62606ee0807f+5:2378:x1874258791782144:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432725.423914:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8b542c-0113-490f-a721-62606ee0807f+5:2378:x1874258791782144:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 28us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432725.423920:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00080000:1.0:1787432725.423947:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432725.423952:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787432725.621944:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432726.650210:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432726.707525:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432726.707707:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791782400 00000100:00100000:3.0:1787432726.707720:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791782400 00000100:00100000:3.0:1787432726.707795:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 252 00000100:00100000:3.0:1787432726.707809:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+11:5619:x1874258791782400:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432726.707829:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432726.707855:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bc2167a00/0xbcb9e331c3f0fc94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a025bdd expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432726.707891:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bc2167a00/0xbcb9e331c3f0fc94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bdd expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432726.707903:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bc2167a00/0xbcb9e331c3f0fc94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bdd expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432726.707915:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2167a00, rc 0) 00000100:00100000:3.0:1787432726.707993:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:5619:x1874258791782400:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 187us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432726.708001:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 252 00000100:00100000:1.0:1787432726.712203:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432726.712366:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791782528 00000100:00100000:0.0:1787432726.712380:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791782528 00000100:00100000:0.0:1787432726.712455:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 253 00000100:00100000:0.0:1787432726.712468:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:5619:x1874258791782528:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432726.712883:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:5619:x1874258791782528:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 417us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432726.712893:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 253 00000100:00100000:0.0:1787432726.720234:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432726.720397:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791782656 00000100:00100000:1.0:1787432726.720412:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791782656 00000100:00100000:1.0:1787432726.720491:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 254 00000100:00100000:1.0:1787432726.720503:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:5619:x1874258791782656:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432726.720848:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:5619:x1874258791782656:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 345us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432726.720857:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 254 00000100:00100000:2.0:1787432726.725822:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432726.726230:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791782784 00000100:00100000:0.0:1787432726.726243:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791782784 00000100:00100000:0.0:1787432726.726322:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 255 00000100:00100000:0.0:1787432726.726334:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:9996:x1874258791782784:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787432726.726849:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:9996:x1874258791782784:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 515us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432726.726859:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 255 00000100:00100000:2.0:1787432726.730978:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432726.731280:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791782912 00000100:00100000:0.0:1787432726.731295:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791782912 00000100:00100000:0.0:1787432726.731382:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 256 00000100:00100000:0.0:1787432726.731396:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:9996:x1874258791782912:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787432726.731785:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:9996:x1874258791782912:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 390us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432726.731794:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 256 00000100:00100000:1.0:1787432726.735708:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432726.736381:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791783040 00000100:00100000:0.0:1787432726.736398:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791783040 00000100:00100000:0.0:1787432726.736482:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 257 00000100:00100000:0.0:1787432726.736495:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:5619:x1874258791783040:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432726.736528:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432726.736554:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935b80030c00/0xbcb9e331c3f0fc9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a025be4 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432726.736604:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935b80030c00/0xbcb9e331c3f0fc9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025be4 expref: 13 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432726.736618:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935b80030c00/0xbcb9e331c3f0fc9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025be4 expref: 13 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432726.736629:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80030c00, rc 0) 00000100:00100000:0.0:1787432726.736737:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:5619:x1874258791783040:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 245us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432726.736747:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 257 00000100:00100000:2.0:1787432726.747558:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432726.747946:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791783168 00000100:00100000:1.0:1787432726.747960:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791783168 00000100:00100000:1.0:1787432726.748045:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 258 00000100:00100000:1.0:1787432726.748058:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:5619:x1874258791783168:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432726.748485:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:5619:x1874258791783168:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 428us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432726.748496:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 258 00000100:00100000:2.0:1787432726.762273:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432726.762524:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791783296 00000100:00100000:1.0:1787432726.762537:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791783296 00000100:00100000:1.0:1787432726.762615:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 259 00000100:00100000:1.0:1787432726.762628:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:5619:x1874258791783296:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432726.762998:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:5619:x1874258791783296:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 371us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432726.763008:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 259 00000100:00100000:3.0:1787432726.766329:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432726.766542:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791783424 00000100:00100000:2.0:1787432726.766556:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791783424 00000100:00100000:2.0:1787432726.766621:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 260 00000100:00100000:2.0:1787432726.766634:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:9999:x1874258791783424:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787432726.767013:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:9999:x1874258791783424:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 379us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432726.768070:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 260 00000100:00100000:3.0:1787432726.771648:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432726.772223:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791783552 00000100:00100000:1.0:1787432726.772256:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791783552 00000100:00100000:1.0:1787432726.772337:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 261 00000100:00100000:1.0:1787432726.772349:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:9999:x1874258791783552:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787432726.772717:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:9999:x1874258791783552:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 368us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432726.772727:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 261 10000000:01000000:0.0:1787432727.222255:0:5864:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787432727.222268:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff935bbb06d800 from 7 10000000:01000000:0.0:1787432727.222275:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787432727.222348:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0fca2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432727.222364:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0fca2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432727.222401:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0fca2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432727.222435:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812788992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787432727.222543:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432727.222634:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a8781ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787432727.222877:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812788992 00000100:00100000:3.0:1787432727.222889:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812788992 00000100:00100000:3.0:1787432727.222961:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787432727.222973:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:5864:x1874258812788992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432727.223001:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432727.223020:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bc2166800/0xbcb9e331c3f0fca9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0fca2 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432727.223051:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bc2166800/0xbcb9e331c3f0fca9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fca2 expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432727.223064:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bc2166800/0xbcb9e331c3f0fca9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fca2 expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432727.223075:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2166800, rc 0) 00000100:00100000:3.0:1787432727.223147:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812788992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432727.223154:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787432727.223365:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812788992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432727.223383:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0fca2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fca9 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432727.223393:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0fca2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fca9 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432727.223468:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812789120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432727.223498:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432727.223528:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a8781ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432727.223694:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812789120 00000100:00100000:2.0:1787432727.223700:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812789120 00000100:00100000:2.0:1787432727.223738:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787432727.223746:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812789120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432727.224073:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87948c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812789120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 327us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432727.224271:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787432727.225277:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812789120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432727.225343:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812789248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432727.225420:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432727.225526:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a8781ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432727.231710:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812789248 00000100:00100000:1.0:1787432727.231734:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812789248 00000100:00100000:1.0:1787432727.231843:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787432727.231859:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812789248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432727.232397:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87949c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812789248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 538us (6973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432727.232407:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787432727.233506:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812789248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432727.237479:0:11720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9928e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:11720:1874258812789376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432727.237614:0:11720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432727.237707:0:11720:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba0fd780 going to sleep for 11 seconds 00000100:00100000:2.0:1787432727.237952:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812789376 00000100:00100000:2.0:1787432727.237963:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812789376 00000100:00100000:2.0:1787432727.238035:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787432727.238049:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:11720:x1874258812789376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432727.238434:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87948050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:11720:x1874258812789376:12345-0@lo:502:llog_process_th.0 Request processed in 375us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432727.238444:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787432727.239278:0:11720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9928e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:11720:1874258812789376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787432727.239353:0:11720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432727.239368:0:11720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432727.239371:0:11720:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787432727.239380:0:11720:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff935bbb06d800 00000020:00000080:3.0:1787432727.239384:0:11720:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787432727.239512:0:11720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9928e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:11720:1874258812789504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432727.239583:0:11720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432727.239641:0:11720:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba0fd780 going to sleep for 11 seconds 00000100:00100000:1.0:1787432727.242421:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812789504 00000100:00100000:1.0:1787432727.242443:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812789504 00000100:00100000:1.0:1787432727.242513:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787432727.242529:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:11720:x1874258812789504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432727.242956:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87949850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:11720:x1874258812789504:12345-0@lo:502:llog_process_th.0 Request processed in 429us (3371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432727.242967:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787432727.245044:0:11720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9928e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:11720:1874258812789504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787432727.245150:0:11720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432727.245163:0:11720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432727.245178:0:11720:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787432727.245186:0:11720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787432727.246397:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787432727.246443:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787432727.246459:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0fca2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fca9 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432727.246475:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0fca2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fca9 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432727.246513:0:5864:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787432727.246516:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff935bbb3e4800 from 7 10000000:01000000:1.0:1787432727.246520:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787432727.246572:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f0fcb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432727.246581:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f0fcb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432727.246593:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f0fcb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432727.246625:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba8fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812789632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787432727.246778:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432727.246844:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432727.247103:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812789632 00000100:00100000:2.0:1787432727.247112:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812789632 00000100:00100000:2.0:1787432727.247204:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787432727.247215:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:5864:x1874258812789632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432727.247234:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432727.247252:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f0fcb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0fcb0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432727.247284:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f0fcb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fcb0 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432727.247297:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f0fcb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fcb0 expref: 18 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432727.247308:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5ea00, rc 0) 00000100:00100000:2.0:1787432727.247371:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812789632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432727.247378:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787432727.249819:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba8fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812789632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432727.249862:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f0fcb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fcb7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432727.249878:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f0fcb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fcb7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432727.249997:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba8fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812789760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432727.250232:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432727.250310:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432727.253059:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812789760 00000100:00100000:2.0:1787432727.253094:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812789760 00000100:00100000:2.0:1787432727.253198:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787432727.253222:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812789760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432727.253735:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812789760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 524us (3501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432727.253745:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787432727.254432:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba8fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812789760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432727.254520:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812789888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432727.254606:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432727.256650:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb7d8f180 going to sleep for 11 seconds 00000100:00100000:3.0:1787432727.267577:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812789888 00000100:00100000:3.0:1787432727.267598:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812789888 00000100:00100000:3.0:1787432727.267696:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787432727.267710:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812789888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432727.271555:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812789888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3830us (16930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432727.271579:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787432727.274142:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812789888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432727.280808:0:11722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:11722:1874258812790016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432727.280939:0:11722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432727.281001:0:11722:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb7d8fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432727.285093:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812790016 00000100:00100000:3.0:1787432727.285119:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812790016 00000100:00100000:2.0:1787432727.286346:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787432727.286365:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:11722:x1874258812790016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432727.286817:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:11722:x1874258812790016:12345-0@lo:502:llog_process_th.0 Request processed in 457us (5877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432727.286826:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787432727.288891:0:11722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:11722:1874258812790016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432727.288959:0:11722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432727.288976:0:11722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432727.288979:0:11722:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787432727.288990:0:11722:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff935bbb3e4800 00000020:00000080:2.0:1787432727.288993:0:11722:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787432727.292590:0:11722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:11722:1874258812790144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432727.292737:0:11722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432727.292882:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812790144 00000100:00100000:0.0:1787432727.292902:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812790144 00000100:00100000:0.0:1787432727.292998:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787432727.293016:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8794a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:11722:x1874258812790144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432727.293371:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8794a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:11722:x1874258812790144:12345-0@lo:502:llog_process_th.0 Request processed in 360us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432727.293381:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787432727.293699:0:11722:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb7d8fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432727.293741:0:11722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:11722:1874258812790144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432727.293789:0:11722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432727.293811:0:11722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432727.293814:0:11722:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787432727.293821:0:11722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787432727.294020:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787432727.294051:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432727.294077:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f0fcb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fcb7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432727.294090:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f0fcb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fcb7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432727.294104:0:5864:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787432727.294107:0:5864:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff935b90e92000 from 7 10000000:01000000:2.0:1787432727.294110:0:5864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787432727.294151:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bbaa5ee00/0xbcb9e331c3f0fcbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432727.294161:0:5864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bbaa5ee00/0xbcb9e331c3f0fcbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432727.294185:0:5864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bbaa5ee00/0xbcb9e331c3f0fcbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432727.294207:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812790272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787432727.294260:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432727.294291:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb7d8fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432727.294311:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812790272 00000100:00100000:2.0:1787432727.301119:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812790272 00000100:00100000:2.0:1787432727.301265:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787432727.301280:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87907850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:5864:x1874258812790272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432727.301308:0:5860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432727.301335:0:5860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bbaa5ec00/0xbcb9e331c3f0fcc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f0fcbe expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432727.301374:0:5860:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bbaa5ec00/0xbcb9e331c3f0fcc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fcbe expref: 19 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432727.301386:0:5860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bbaa5ec00/0xbcb9e331c3f0fcc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f0fcbe expref: 19 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432727.301398:0:5860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5ec00, rc 0) 00000100:00100000:2.0:1787432727.301519:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87907850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812790272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 241us (7257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432727.301527:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787432727.301612:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812790272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432727.301635:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bbaa5ee00/0xbcb9e331c3f0fcbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fcc5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432727.301647:0:5864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bbaa5ee00/0xbcb9e331c3f0fcbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fcc5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432727.301759:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812790400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432727.301803:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432727.301847:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb7d8fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432727.301866:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812790400 00000100:00100000:2.0:1787432727.301890:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812790400 00000100:00100000:2.0:1787432727.301919:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787432727.301925:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812790400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432727.302274:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812790400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 348us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432727.302282:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787432727.302313:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812790400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787432727.302347:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812790528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432727.302390:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432727.302405:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb7d8fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432727.302416:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812790528 00000100:00100000:2.0:1787432727.302420:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812790528 00000100:00100000:2.0:1787432727.302438:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787432727.302444:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812790528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432727.302598:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:5864:x1874258812790528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432727.302605:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787432727.302644:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:5864:1874258812790528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787432727.325637:0:11724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:11724:1874258812790656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432727.325794:0:11724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432727.325864:0:11724:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb7d8f180 going to sleep for 11 seconds 00000100:00100000:3.0:1787432727.326542:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812790656 00000100:00100000:3.0:1787432727.326568:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812790656 00000100:00100000:3.0:1787432727.326645:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787432727.326701:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87904450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:11724:x1874258812790656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432727.326984:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87904450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:11724:x1874258812790656:12345-0@lo:502:llog_process_th.0 Request processed in 327us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432727.326992:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787432727.328048:0:11724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:11724:1874258812790656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432727.328115:0:11724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432727.328132:0:11724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432727.328145:0:11724:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787432727.328155:0:11724:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff935b90e92000 00000020:00000080:2.0:1787432727.328158:0:11724:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787432727.328294:0:11724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:11724:1874258812790784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432727.328380:0:11724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432727.328432:0:11724:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb7d8f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787432727.328618:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812790784 00000100:00100000:1.0:1787432727.328626:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812790784 00000100:00100000:1.0:1787432727.328732:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787432727.328744:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:11724:x1874258812790784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432727.329051:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87906050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:11724:x1874258812790784:12345-0@lo:502:llog_process_th.0 Request processed in 309us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432727.329072:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000040:00080000:0.0:1787432727.332849:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787432727.335277:0:11724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:11724:1874258812790784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787432727.335340:0:11724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432727.335354:0:11724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432727.335357:0:11724:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787432727.335363:0:11724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787432727.335535:0:5864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787432727.335573:0:5864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787432727.335588:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bbaa5ee00/0xbcb9e331c3f0fcbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fcc5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432727.335605:0:5864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bbaa5ee00/0xbcb9e331c3f0fcbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fcc5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432727.670328:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787432728.374625:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787432728.697177:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432728.825949:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812791296:0@lo:400:kworker.0 00000100:00100000:1.0:1787432728.826058:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432728.826191:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787432728.826198:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812790912:0@lo:400:kworker.0 00000100:00100000:1.0:1787432728.826233:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432728.826259:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812791424:0@lo:400:kworker.0 00000100:00100000:1.0:1787432728.826286:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432728.826332:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812791168:0@lo:400:kworker.0 00000100:00100000:1.0:1787432728.826357:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432728.826377:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787432728.826383:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812791040:0@lo:400:kworker.0 00000100:00100000:1.0:1787432728.826405:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432728.826445:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812791552:0@lo:400:kworker.0 00000100:00100000:1.0:1787432728.826470:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432728.826504:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812791424 00000100:00100000:1.0:1787432728.826514:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812791424 00000100:00100000:1.0:1787432728.826578:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812791168 00000100:00100000:1.0:1787432728.826582:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812791168 00000100:00100000:1.0:1787432728.826605:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812791040 00000100:00100000:1.0:1787432728.826608:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812791040 00000100:00100000:1.0:1787432728.826627:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787432728.826635:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812791424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432728.826727:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812791424:12345-0@lo:400:kworker.0 Request processed in 92us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432728.826735:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787432728.826757:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787432728.826764:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812791168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432728.826800:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812791168:12345-0@lo:400:kworker.0 Request processed in 37us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432728.826806:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787432728.826817:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787432728.826823:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812791040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432728.826848:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812791040:12345-0@lo:400:kworker.0 Request processed in 25us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432728.826854:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787432728.826881:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812791296 00000100:00100000:1.0:1787432728.826884:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812791296 00000100:00100000:1.0:1787432728.826908:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812791552 00000100:00100000:1.0:1787432728.826912:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812791552 00000100:00100000:1.0:1787432728.826931:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787432728.826945:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812791296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432728.826977:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812791296:12345-0@lo:400:kworker.0 Request processed in 33us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432728.826984:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787432728.826997:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787432728.827002:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3333:x1874258812791552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432728.827029:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3333:x1874258812791552:12345-0@lo:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432728.827035:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1787432728.827050:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432728.827054:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787432728.827057:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432728.827104:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812791040:0@lo:400:kworker.0 00000100:00100000:1.0:1787432728.827116:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812791552:0@lo:400:kworker.0 00000100:00100000:1.0:1787432728.827126:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812791168:0@lo:400:kworker.0 00000100:00100000:1.0:1787432728.827174:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812791424:0@lo:400:kworker.0 00010000:00080000:1.0:1787432728.827190:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb9a95500 x1874258812791296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432728.827202:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812791296:0@lo:400:kworker.0 00000100:00100000:2.0:1787432728.827795:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812790912 00000100:00100000:2.0:1787432728.827803:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812790912 00000100:00100000:2.0:1787432728.827862:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787432728.827872:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87906c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812790912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432728.827960:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87906c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812790912:12345-0@lo:400:kworker.0 Request processed in 90us (1725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432728.827966:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787432728.828015:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812790912:0@lo:400:kworker.0 00000100:00100000:3.0:1787432729.334159:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787432729.334191:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812791680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432729.334317:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432729.334404:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812791680 00000100:00100000:3.0:1787432729.334414:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812791680 00000100:00100000:3.0:1787432729.334472:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787432729.334484:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9929c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812791680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432729.334532:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787432729.334594:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9929c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812791680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432729.334602:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1787432729.334652:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb9928e00 x1874258812791680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432729.334689:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812791680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432729.338548:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432729.338584:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812791808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432729.338693:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432729.338769:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812791808 00000100:00100000:0.0:1787432729.338779:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812791808 00000100:00100000:0.0:1787432729.341230:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787432729.341257:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3331:x1874258812791808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787432729.341308:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787432729.341410:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3331:x1874258812791808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (2717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432729.341418:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787432729.341511:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812791808:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787432729.412899:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000004:00080000:0.0:1787432729.417581:0:5889:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:0.0:1787432729.722447:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432730.547625:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432730.547805:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432730.547853:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432730.547954:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432730.548085:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791783808 00000100:00100000:1.0:1787432730.548097:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791783808 00000100:00100000:1.0:1787432730.548187:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791784064 00000100:00100000:1.0:1787432730.548191:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791784064 00000100:00100000:1.0:1787432730.548227:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 114 00000100:00100000:1.0:1787432730.548255:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791783808:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432730.548338:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791783808:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 85us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432730.548345:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 114 00000100:00100000:1.0:1787432730.548363:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 115 00000100:00100000:1.0:1787432730.548370:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2375:x1874258791784064:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432730.548393:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2375:x1874258791784064:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 24us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432730.548400:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 115 00000100:00100000:1.0:1787432730.548417:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791783936 00000100:00100000:1.0:1787432730.548420:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791783936 00000100:00100000:1.0:1787432730.548445:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 64 00000100:00100000:1.0:1787432730.548451:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb992b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791783936:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432730.548473:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb992b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791783936:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 23us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432730.548480:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 64 00000100:00080000:3.0:1787432730.548961:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432730.548968:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432730.549550:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791783680 00000100:00100000:0.0:1787432730.549559:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791783680 00000100:00100000:0.0:1787432730.549617:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 278 00000100:00100000:0.0:1787432730.549628:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2375:x1874258791783680:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432730.549749:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2375:x1874258791783680:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 123us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432730.549772:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 278 00010000:00010000:1.0:1787432730.742031:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432731.771406:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432732.790610:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432733.816722:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432733.943015:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812792192:0@lo:400:kworker.0 00000100:00100000:1.0:1787432733.943226:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812792320:0@lo:400:kworker.0 00000100:00100000:2.0:1787432733.943366:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba866300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812792064:0@lo:400:kworker.0 00000100:00100000:0.0:1787432733.943443:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812791936:0@lo:400:kworker.0 00000100:00100000:1.0:1787432733.951358:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432733.951504:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812792320 00000100:00100000:1.0:1787432733.951516:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812792320 00000100:00100000:1.0:1787432733.951604:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787432733.951617:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812792320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432733.951710:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812792320:12345-0@lo:400:kworker.0 Request processed in 96us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432733.951735:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1787432733.951788:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935a84b44e00 x1874258812792320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432733.951804:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812792320:0@lo:400:kworker.0 00000100:00080000:1.0:1787432733.951866:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787432733.957042:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432733.957151:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812792576:0@lo:400:kworker.0 00000100:00100000:2.0:1787432733.957211:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432733.957318:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812792576 00000100:00100000:2.0:1787432733.957329:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812792576 00000100:00100000:2.0:1787432733.957404:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787432733.957416:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812792576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432733.957480:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812792576:12345-0@lo:400:kworker.0 Request processed in 66us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432733.957487:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1787432733.957514:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432733.957566:0:3332:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1787432733.957573:0:3332:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff935bb9a96a00, transno 4294967300 00000100:00100000:2.0:1787432733.957587:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812792576:0@lo:400:kworker.0 00000100:00100000:1.0:1787432733.960813:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812792064 00000100:00100000:1.0:1787432733.960835:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812792064 00000100:00100000:1.0:1787432733.960951:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787432733.960964:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812792064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432733.961092:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812792064:12345-0@lo:400:kworker.0 Request processed in 132us (4064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432733.961100:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787432733.961541:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba866300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812792064:0@lo:400:kworker.0 00000100:00100000:3.0:1787432733.962746:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432733.962928:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812792192 00000100:00100000:1.0:1787432733.962938:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812792192 00000100:00100000:1.0:1787432733.963027:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787432733.963039:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812792192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432733.963145:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812792192:12345-0@lo:400:kworker.0 Request processed in 108us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432733.963153:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787432733.964994:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812792192:0@lo:400:kworker.0 00000100:00080000:2.0:1787432733.967339:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432733.975054:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432733.975932:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812792448:0@lo:400:kworker.0 00000100:00100000:0.0:1787432733.976007:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432733.976622:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812791936 00000100:00100000:3.0:1787432733.976634:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812791936 00000100:00100000:3.0:1787432733.976724:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787432733.976736:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3331:x1874258812791936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432733.976831:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3331:x1874258812791936:12345-0@lo:400:kworker.0 Request processed in 96us (1791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432733.976858:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787432733.977061:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812791936:0@lo:400:kworker.0 00000100:00100000:2.0:1787432733.977224:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812792448 00000100:00100000:2.0:1787432733.977230:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812792448 00000100:00100000:2.0:1787432733.977308:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787432733.977317:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812792448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432733.977374:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812792448:12345-0@lo:400:kworker.0 Request processed in 59us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432733.977380:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787432733.977415:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812792448:0@lo:400:kworker.0 00000100:00080000:1.0:1787432733.977542:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432734.454166:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432734.454199:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a84b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812792704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432734.454297:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432734.455702:0:9985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812792704 00000100:00100000:3.0:1787432734.455719:0:9985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812792704 00000100:00100000:3.0:1787432734.455791:0:9985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787432734.455803:0:9985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812792704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432734.455852:0:9985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787432734.455952:0:9985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812792704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (1654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432734.455961:0:9985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787432734.457602:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812792832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432734.457711:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432734.457835:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812792832 00000100:00100000:0.0:1787432734.457846:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812792832 00000100:00100000:0.0:1787432734.457912:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787432734.457924:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812792832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787432734.457963:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787432734.458029:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812792832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432734.458037:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787432734.458146:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812792832:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787432734.458565:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935a84b44000 x1874258812792704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432734.458601:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a84b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812792704:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787432734.840277:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432735.670394:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432735.670455:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432735.670492:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432735.670526:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432735.670577:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791784320 00000100:00100000:3.0:1787432735.670588:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791784320 00000100:00100000:3.0:1787432735.670682:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791784576 00000100:00100000:3.0:1787432735.670685:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791784576 00000100:00100000:3.0:1787432735.670715:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 119 00000100:00100000:3.0:1787432735.671349:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791784320:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432735.671454:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791784320:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 728us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432735.671463:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 119 00000100:00100000:3.0:1787432735.671490:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 120 00000100:00100000:3.0:1787432735.671498:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2375:x1874258791784576:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432735.671525:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2375:x1874258791784576:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 28us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432735.671551:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 120 00000100:00100000:3.0:1787432735.673462:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791784192 00000100:00100000:3.0:1787432735.673482:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791784192 00000100:00100000:3.0:1787432735.673570:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 280 00000100:00100000:3.0:1787432735.673583:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87905c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2375:x1874258791784192:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432735.673702:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87905c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2375:x1874258791784192:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 120us (3207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432735.673711:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 280 00000100:00100000:3.0:1787432735.673780:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791784448 00000100:00100000:3.0:1787432735.673785:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791784448 00000100:00100000:3.0:1787432735.673828:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 67 00000100:00100000:3.0:1787432735.673836:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791784448:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432735.673870:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791784448:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 36us (3344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432735.673877:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 67 00000100:00080000:3.0:1787432735.673897:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432735.673903:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787432735.864729:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432736.886000:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432737.910112:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787432738.614524:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787432738.934587:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432739.065897:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812793088:0@lo:400:kworker.0 00000100:00100000:3.0:1787432739.065995:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432739.066093:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812793600:0@lo:400:kworker.0 00000100:00100000:1.0:1787432739.066118:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812793344:0@lo:400:kworker.0 00000100:00100000:3.0:1787432739.066124:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432739.066152:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432739.066158:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787432739.066164:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3332:1874258812793216:0@lo:400:kworker.0 00000100:00100000:1.0:1787432739.066196:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787432739.066202:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812792960:0@lo:400:kworker.0 00000100:00100000:3.0:1787432739.066207:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432739.066232:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432739.066246:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812793088 00000100:00100000:1.0:1787432739.066250:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812793472:0@lo:400:kworker.0 00000100:00100000:3.0:1787432739.066255:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812793088 00000100:00100000:1.0:1787432739.066270:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432739.066298:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812793600 00000100:00100000:1.0:1787432739.066301:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812793600 00000100:00100000:3.0:1787432739.066308:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812793216 00000100:00100000:3.0:1787432739.066311:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812793216 00000100:00100000:1.0:1787432739.066342:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812793344 00000100:00100000:1.0:1787432739.066345:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812793344 00000100:00100000:2.0:1787432739.066393:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812793472 00000100:00100000:2.0:1787432739.066397:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812793472 00000100:00100000:0.0:1787432739.067897:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812792960 00000100:00100000:0.0:1787432739.067911:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812792960 00000100:00100000:0.0:1787432739.067988:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787432739.068000:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87904050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812792960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432739.068142:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87904050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812792960:12345-0@lo:400:kworker.0 Request processed in 144us (1908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432739.068151:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1787432739.068518:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787432739.068528:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812793088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432739.068579:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812793088:12345-0@lo:400:kworker.0 Request processed in 53us (2585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432739.068586:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787432739.068600:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787432739.068608:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1874258812793216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432739.068638:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1874258812793216:12345-0@lo:400:kworker.0 Request processed in 31us (2430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432739.068645:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787432739.068825:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3332:1874258812793216:0@lo:400:kworker.0 00000100:00100000:3.0:1787432739.068839:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812793088:0@lo:400:kworker.0 00000100:00100000:3.0:1787432739.068903:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787432739.068913:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812793600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432739.068957:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812793600:12345-0@lo:400:kworker.0 Request processed in 46us (2831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432739.068964:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787432739.068997:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812793600:0@lo:400:kworker.0 00000100:00100000:3.0:1787432739.069045:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812792960:0@lo:400:kworker.0 00000100:00100000:1.0:1787432739.070841:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787432739.070862:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812793344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432739.070980:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812793344:12345-0@lo:400:kworker.0 Request processed in 125us (4827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432739.070989:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1787432739.071050:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb9fd1c00 x1874258812793344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432739.071081:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812793344:0@lo:400:kworker.0 00000100:00100000:2.0:1787432739.074257:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787432739.074282:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812793472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432739.074432:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812793472:12345-0@lo:400:kworker.0 Request processed in 159us (8159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432739.074441:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787432739.074545:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812793472:0@lo:400:kworker.0 00000100:00080000:0.0:1787432739.074670:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787432739.074678:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787432739.074681:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432739.579174:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787432739.579210:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812793728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432739.579316:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432739.579576:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812793728 00000100:00100000:0.0:1787432739.579587:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812793728 00000100:00100000:0.0:1787432739.579674:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787432739.579698:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812793728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432739.579745:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787432739.579808:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812793728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432739.579816:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1787432739.581153:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbabbe680 x1874258812793728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432739.581209:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812793728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432739.581649:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432739.581687:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812793856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432739.582075:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432739.582769:0:9985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812793856 00000100:00100000:2.0:1787432739.582782:0:9985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812793856 00000100:00100000:2.0:1787432739.582854:0:9985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787432739.582889:0:9985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812793856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432739.583487:0:9985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432739.583603:0:9985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812793856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 714us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432739.583614:0:9985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787432739.583815:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812793856:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787432739.957999:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432740.789299:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432740.789378:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432740.789486:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791784704 00000100:00100000:0.0:1787432740.789499:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791784704 00000100:00100000:0.0:1787432740.789599:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 282 00000100:00100000:0.0:1787432740.789612:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87905850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2378:x1874258791784704:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432740.789780:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87905850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2378:x1874258791784704:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 170us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432740.789788:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 282 00000100:00100000:3.0:1787432740.801603:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791784832 00000100:00100000:3.0:1787432740.801627:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791784832 00000100:00100000:3.0:1787432740.801786:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 124 00000100:00100000:3.0:1787432740.801800:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+5:2378:x1874258791784832:12345-192.168.202.15@tcp:400:kworker.0 00000100:00080000:0.0:1787432740.801815:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432740.801939:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+5:2378:x1874258791784832:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 141us (12559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432740.801947:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 124 00000100:00100000:0.0:1787432740.814856:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432740.822175:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791784960 00000100:00100000:3.0:1787432740.822200:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791784960 00000100:00100000:3.0:1787432740.822311:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:3.0:1787432740.822326:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2374:x1874258791784960:12345-192.168.202.15@tcp:9:kworker.0 00000020:00000080:3.0:1787432740.822374:0:8446:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0fc01 00000100:00080000:3.0:1787432740.822388:0:8446:0:(import.c:65:import_set_state_nolock()) ffff935b87de8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787432740.822472:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1787432740.822506:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432740.823106:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432740.823504:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+2:2374:x1874258791784960:12345-192.168.202.15@tcp:9:kworker.0 Request processed in 1180us (8665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432740.823517:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00080000:0.0:1787432740.823614:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432740.823648:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791785088 00000100:00100000:2.0:1787432740.823701:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791785088 00000100:00100000:2.0:1787432740.823766:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 125 00000100:00100000:2.0:1787432740.823777:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2377:x1874258791785088:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787432740.823840:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2377:x1874258791785088:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 64us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432740.823846:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 125 00000100:00080000:0.0:1787432740.824071:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787432740.987326:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432742.008780:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432743.029865:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432744.054170:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432744.182005:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812794240:0@lo:400:kworker.0 00000100:00100000:2.0:1787432744.182123:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432744.182204:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787432744.182209:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812794112:0@lo:400:kworker.0 00000100:00100000:2.0:1787432744.182228:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432744.182240:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812794624:0@lo:400:kworker.0 00000100:00100000:2.0:1787432744.182260:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432744.182291:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812794240 00000100:00100000:2.0:1787432744.182301:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812794240 00000100:00100000:2.0:1787432744.182365:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812794112 00000100:00100000:2.0:1787432744.182368:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812794112 00000100:00100000:2.0:1787432744.182391:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787432744.182399:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812794240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432744.182463:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812794240:12345-0@lo:400:kworker.0 Request processed in 64us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432744.182469:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787432744.182484:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787432744.182488:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812794112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432744.182504:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812794112:12345-0@lo:400:kworker.0 Request processed in 15us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432744.182509:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787432744.182548:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812794112:0@lo:400:kworker.0 00000100:00100000:1.0:1787432744.182823:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812794368:0@lo:400:kworker.0 00000100:00100000:2.0:1787432744.182882:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812794240:0@lo:400:kworker.0 00000100:00100000:2.0:1787432744.182936:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812794624 00000100:00100000:2.0:1787432744.182941:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812794624 00000100:00100000:2.0:1787432744.182980:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787432744.182986:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812794624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432744.189204:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812793984:0@lo:400:kworker.0 00000100:00080000:3.0:1787432744.191727:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432744.191749:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432744.192147:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432744.192332:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812794368 00000100:00100000:3.0:1787432744.192345:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812794368 00000100:00100000:3.0:1787432744.192420:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787432744.192446:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812794368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432744.192506:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812794368:12345-0@lo:400:kworker.0 Request processed in 62us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432744.192514:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1787432744.192969:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787432744.193007:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb9fd2a00 x1874258812794368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432744.193034:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812794368:0@lo:400:kworker.0 00000100:00100000:2.0:1787432744.193738:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812794624:12345-0@lo:400:kworker.0 Request processed in 10732us (11456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432744.193753:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787432744.194253:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432744.194314:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812794496:0@lo:400:kworker.0 00000100:00100000:0.0:1787432744.194353:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432744.194551:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812793984 00000100:00100000:1.0:1787432744.194570:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812793984 00000100:00100000:1.0:1787432744.194619:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787432744.194625:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3331:x1874258812793984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432744.194700:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87905450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3331:x1874258812793984:12345-0@lo:400:kworker.0 Request processed in 75us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432744.194705:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787432744.195008:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812793984:0@lo:400:kworker.0 00000100:00100000:2.0:1787432744.195292:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812794496 00000100:00100000:2.0:1787432744.195298:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812794496 00000100:00100000:2.0:1787432744.195576:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787432744.195586:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812794496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432744.195653:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812794496:12345-0@lo:400:kworker.0 Request processed in 69us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432744.195687:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787432744.199095:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812794496:0@lo:400:kworker.0 00000100:00100000:3.0:1787432744.200907:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812794624:0@lo:400:kworker.0 00000100:00080000:1.0:1787432744.201856:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432744.694048:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787432744.694079:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812794752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432744.694170:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432744.694262:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812794752 00000100:00100000:3.0:1787432744.694271:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812794752 00000100:00100000:3.0:1787432744.694329:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787432744.694339:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812794752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432744.694382:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787432744.694434:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812794752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432744.694443:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1787432744.694495:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbabbd880 x1874258812794752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432744.694516:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812794752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432744.700535:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432744.700577:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812794880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432744.700722:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432744.700798:0:9985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812794880 00000100:00100000:2.0:1787432744.700807:0:9985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812794880 00000100:00100000:2.0:1787432744.700869:0:9985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787432744.700881:0:9985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812794880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432744.701087:0:9985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432744.701143:0:9985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812794880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 264us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432744.701152:0:9985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787432744.701206:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812794880:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1787432744.791897:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ee8b542c-0113-490f-a721-62606ee0807f 00000020:00000080:1.0:1787432744.791910:0:7682:0:(genops.c:885:class_export_put()) final put ffff935b98a87000/ee8b542c-0113-490f-a721-62606ee0807f 00000020:00000080:3.0:1787432744.792373:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff935b98a87000/ee8b542c-0113-490f-a721-62606ee0807f for lustre-OST0001 00000020:00000080:3.0:1787432744.792436:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935b87de8000 for lustre-OST0001 00010000:00010000:1.0:1787432745.079080:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432745.905070:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432745.905169:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432745.905208:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432745.905246:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791785216 00000100:00100000:1.0:1787432745.905272:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791785216 00000100:00100000:1.0:1787432745.905337:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 284 00000100:00100000:1.0:1787432745.905350:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2376:x1874258791785216:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432745.905439:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2376:x1874258791785216:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 91us (3220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432745.905448:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 284 00000100:00100000:1.0:1787432745.905491:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791785472 00000100:00100000:1.0:1787432745.905495:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791785472 00000100:00100000:1.0:1787432745.905545:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791785344 00000100:00100000:1.0:1787432745.905549:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791785344 00000100:00100000:1.0:1787432745.905576:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 129 00000100:00100000:1.0:1787432745.905584:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2376:x1874258791785472:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432745.905631:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2376:x1874258791785472:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 48us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432745.905637:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 129 00000100:00100000:1.0:1787432745.905649:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 130 00000100:00100000:1.0:1787432745.905685:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+5:2376:x1874258791785344:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432745.905715:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+5:2376:x1874258791785344:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 59us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432745.905722:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 130 00000100:00080000:1.0:1787432745.905751:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787432746.101788:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432747.128720:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432748.149935:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787432748.855179:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787432749.174263:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432749.305605:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba8fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812795008:0@lo:400:kworker.0 00000100:00100000:2.0:1787432749.305778:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432749.305849:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812795520:0@lo:400:kworker.0 00000100:00100000:2.0:1787432749.305896:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432749.305979:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812795392:0@lo:400:kworker.0 00000100:00100000:3.0:1787432749.306020:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432749.306077:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812795136:0@lo:400:kworker.0 00000100:00100000:3.0:1787432749.306125:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812795264:0@lo:400:kworker.0 00000100:00100000:3.0:1787432749.306169:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812795392 00000100:00100000:3.0:1787432749.306178:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812795392 00000100:00100000:3.0:1787432749.306278:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787432749.306294:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812795392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432749.306374:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812795392:12345-0@lo:400:kworker.0 Request processed in 86us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432749.306382:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1787432749.306408:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787432749.306445:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbb5baa00 x1874258812795392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432749.306461:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812795392:0@lo:400:kworker.0 00000100:00100000:1.0:1787432749.306737:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812795008 00000100:00100000:1.0:1787432749.306744:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812795008 00000100:00100000:1.0:1787432749.306798:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787432749.306806:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3331:x1874258812795008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432749.306854:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3331:x1874258812795008:12345-0@lo:400:kworker.0 Request processed in 49us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432749.306861:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787432749.312610:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba8fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812795008:0@lo:400:kworker.0 00000100:00100000:2.0:1787432749.312720:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432749.312768:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432749.312802:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812795648:0@lo:400:kworker.0 00000100:00100000:2.0:1787432749.312896:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432749.313464:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812795520 00000100:00100000:1.0:1787432749.313476:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812795520 00000100:00100000:1.0:1787432749.313575:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812795264 00000100:00100000:1.0:1787432749.313579:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812795264 00000100:00100000:1.0:1787432749.313602:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812795136 00000100:00100000:1.0:1787432749.313606:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812795136 00000100:00100000:1.0:1787432749.313630:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787432749.313640:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812795520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432749.313752:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812795520:12345-0@lo:400:kworker.0 Request processed in 112us (7853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432749.313760:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787432749.313783:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787432749.313790:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812795264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432749.313831:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812795264:12345-0@lo:400:kworker.0 Request processed in 41us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432749.313837:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787432749.313850:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787432749.313857:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812795136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432749.314144:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812795648 00000100:00100000:2.0:1787432749.314149:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812795648 00000100:00100000:2.0:1787432749.314191:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787432749.314219:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812795648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432749.314268:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812795648:12345-0@lo:400:kworker.0 Request processed in 50us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432749.314275:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787432749.314337:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812795648:0@lo:400:kworker.0 00000100:00080000:2.0:1787432749.314383:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787432749.314389:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432749.314467:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812795520:0@lo:400:kworker.0 00000100:00100000:2.0:1787432749.314535:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812795264:0@lo:400:kworker.0 00000100:00100000:1.0:1787432749.314614:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812795136:12345-0@lo:400:kworker.0 Request processed in 755us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432749.314621:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787432749.315753:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812795136:0@lo:400:kworker.0 00000100:00100000:3.0:1787432749.815684:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812795776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432749.816323:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432749.816442:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812795776 00000100:00100000:1.0:1787432749.816480:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812795776 00000100:00100000:1.0:1787432749.816565:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787432749.816578:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812795776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432749.816630:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432749.817534:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812795904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432749.817595:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432749.817645:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812795904 00000100:00100000:2.0:1787432749.817651:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812795904 00000100:00100000:2.0:1787432749.817713:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787432749.817722:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812795904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432749.817752:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432749.817805:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812795904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432749.817814:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787432749.817874:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812795904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432749.819131:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812795776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2548us (2802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432749.819146:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1787432749.819580:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa62a00 x1874258812795776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432749.819608:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812795776:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787432750.198171:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787432750.256557:0:11892:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 17:05:48 (1787432748) 00000100:00100000:1.0:1787432751.025980:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432751.026035:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432751.026070:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432751.026105:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791785728 00000100:00100000:1.0:1787432751.026115:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791785728 00000100:00100000:1.0:1787432751.026183:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791785856 00000100:00100000:1.0:1787432751.026186:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791785856 00000100:00100000:1.0:1787432751.026209:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 134 00000100:00100000:1.0:1787432751.026220:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2376:x1874258791785728:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432751.026294:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2376:x1874258791785728:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 76us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432751.026301:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 134 00000100:00100000:1.0:1787432751.026318:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 135 00000100:00100000:1.0:1787432751.026325:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2376:x1874258791785856:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432751.026364:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2376:x1874258791785856:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 40us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432751.026370:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 135 00000100:00080000:1.0:1787432751.026388:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432751.026505:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791785600 00000100:00100000:0.0:1787432751.026510:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791785600 00000100:00100000:0.0:1787432751.026549:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 286 00000100:00100000:0.0:1787432751.026556:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2376:x1874258791785600:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432751.026586:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2376:x1874258791785600:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 30us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432751.026592:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 286 00010000:00010000:1.0:1787432751.222726:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432752.246066:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432752.363780:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432752.363907:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791785984 00000100:00100000:2.0:1787432752.363921:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791785984 00000100:00100000:2.0:1787432752.364027:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00100000:2.0:1787432752.364040:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+5:10268:x1874258791785984:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787432752.364069:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432752.364102:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fccc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025beb expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432752.364196:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f0fcd3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432752.364213:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f0fcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432752.364227:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f0fcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432752.365350:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787432752.365359:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787432752.365470:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f0fcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432752.365511:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fccc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025beb expref: 7 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432752.365533:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f0fcd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025beb expref: 6 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432752.365552:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b952e8200) 00010000:00010000:2.0:1787432752.365555:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787432752.365560:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f400, rc 0) 00000100:00100000:2.0:1787432752.365648:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+6:10268:x1874258791785984:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 1609us (1880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432752.365713:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00100000:0.0:1787432752.381550:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432752.381766:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791786112 00000100:00100000:1.0:1787432752.381809:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791786112 00000100:00100000:1.0:1787432752.381903:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:1.0:1787432752.381917:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+6:10269:x1874258791786112:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787432752.381964:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432752.381998:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fcda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025bf2 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.382099:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fce1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.382117:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fce1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.382132:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fce1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.382369:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fce8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.382378:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fce8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.382386:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fce8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.382959:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f0fcef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.382972:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f0fcef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.382981:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f0fcef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432752.383090:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787432752.383096:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787432752.384630:0:5869:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f0fcef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.384676:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fce1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.384685:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fce1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.384694:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fce1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.384701:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6a00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432752.384707:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fce1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.384716:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fce1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.384737:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b952e8200) 00010000:00010000:1.0:1787432752.384740:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432752.384745:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fce1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.384752:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f0fce1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.384770:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fce8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.384790:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fce8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.384796:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fce8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.384801:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e7c00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432752.384804:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fce8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.384810:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fce8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.384819:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff935ba2a69800) 00010000:00010000:1.0:1787432752.384822:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432752.384825:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fce8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.384832:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f0fce8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.384896:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f0fcda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bf2 expref: 8 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.384915:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f0fcef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bf2 expref: 7 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432752.384924:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff935ba2a69500) 00010000:00010000:1.0:1787432752.384927:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787432752.384945:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e7000, rc 0) 00000100:00100000:1.0:1787432752.385058:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+7:10269:x1874258791786112:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 3143us (3534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432752.385070:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:1.0:1787432752.389476:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432752.389629:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791786368 00000100:00100000:3.0:1787432752.389643:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791786368 00000100:00100000:3.0:1787432752.389748:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:3.0:1787432752.389763:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+7:10269:x1874258791786368:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432752.389793:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432752.389823:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fcf6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025bf9 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.389924:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fcfd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.390343:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fcfd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.390374:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fcfd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.397005:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd04 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.397031:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.397043:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.397630:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210600/0xbcb9e331c3f0fd0b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.397642:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210600/0xbcb9e331c3f0fd0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.397650:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210600/0xbcb9e331c3f0fd0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432752.397682:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787432752.397911:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fcfd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.397919:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fcfd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.397927:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fcfd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.397933:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2167200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432752.397956:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fcfd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.397963:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fcfd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.397976:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff935ba2a69500) 00010000:00010000:3.0:1787432752.397979:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432752.397983:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fcfd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.397989:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fcfd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.398003:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.398009:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd04 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.398014:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.398019:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2166000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432752.398022:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.398027:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd04 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.398034:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff935b8304a900) 00010000:00010000:3.0:1787432752.398036:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432752.398045:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd04 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.398052:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd04 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.398447:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fcf6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bf9 expref: 10 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.398463:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210600/0xbcb9e331c3f0fd0b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bf9 expref: 9 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432752.398470:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff935b8304a100) 00010000:00010000:3.0:1787432752.398473:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432752.398475:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bb5210600, rc 0) 00000100:00100000:3.0:1787432752.398561:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+9:10269:x1874258791786368:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 8801us (9102us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787432752.398571:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:3.0:1787432752.405596:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432752.406334:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791786496 00000100:00100000:2.0:1787432752.406346:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791786496 00000100:00100000:2.0:1787432752.406428:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:2.0:1787432752.406439:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+9:10269:x1874258791786496:12345-192.168.202.15@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787432752.406560:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+9:10269:x1874258791786496:12345-192.168.202.15@tcp:59:lhsmtool_posix.0 Request processed in 122us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432752.406568:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 35 00000040:00080000:3.0:1787432752.964112:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787432753.269841:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432754.294437:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432754.437336:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812796032:0@lo:400:kworker.0 00000100:00100000:2.0:1787432754.437463:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432754.437585:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432754.437597:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812796160:0@lo:400:kworker.0 00000100:00100000:2.0:1787432754.437647:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432754.437827:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812796032 00000100:00100000:3.0:1787432754.437839:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812796032 00000100:00100000:3.0:1787432754.437933:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787432754.437947:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87906850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3331:x1874258812796032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432754.438013:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87906850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3331:x1874258812796032:12345-0@lo:400:kworker.0 Request processed in 70us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432754.438021:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787432754.438088:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812796032:0@lo:400:kworker.0 00000100:00100000:2.0:1787432754.438722:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812796160 00000100:00100000:2.0:1787432754.438730:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812796160 00000100:00100000:2.0:1787432754.438772:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787432754.438780:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812796160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432754.438837:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812796160:12345-0@lo:400:kworker.0 Request processed in 58us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432754.438855:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787432754.438926:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812796160:0@lo:400:kworker.0 00000100:00100000:2.0:1787432754.438979:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812796288:0@lo:400:kworker.0 00000100:00100000:2.0:1787432754.439013:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432754.439065:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812796416:0@lo:400:kworker.0 00000100:00100000:2.0:1787432754.439099:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432754.439144:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432754.439151:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba8fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812796544:0@lo:400:kworker.0 00000100:00100000:2.0:1787432754.439177:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432754.439203:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812796288 00000100:00100000:2.0:1787432754.439207:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812796288 00000100:00100000:2.0:1787432754.439247:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812796544 00000100:00100000:2.0:1787432754.439250:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812796544 00000100:00100000:2.0:1787432754.439271:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787432754.439277:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812796288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432754.439315:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812796288:12345-0@lo:400:kworker.0 Request processed in 37us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432754.439321:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787432754.439334:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787432754.439341:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812796544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432754.439372:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812796544:12345-0@lo:400:kworker.0 Request processed in 32us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432754.439378:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1787432754.439394:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432754.439414:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba8fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812796544:0@lo:400:kworker.0 00000100:00100000:2.0:1787432754.439443:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812796288:0@lo:400:kworker.0 00000100:00100000:2.0:1787432754.439466:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432754.439471:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba866300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812796672:0@lo:400:kworker.0 00000100:00100000:2.0:1787432754.439495:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432754.443105:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812796416 00000100:00100000:3.0:1787432754.443132:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812796416 00000100:00100000:3.0:1787432754.443391:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812796672 00000100:00100000:3.0:1787432754.443396:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812796672 00000100:00100000:3.0:1787432754.443430:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787432754.443442:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812796416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432754.443561:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812796416:12345-0@lo:400:kworker.0 Request processed in 123us (4461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432754.443569:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787432754.443587:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787432754.443593:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812796672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432754.443639:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812796672:12345-0@lo:400:kworker.0 Request processed in 46us (4143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432754.443644:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787432754.444992:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432754.445001:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787432754.445373:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb9fd1f80 x1874258812796416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787432770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432754.445393:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812796416:0@lo:400:kworker.0 00000100:00100000:3.0:1787432754.445450:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba866300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812796672:0@lo:400:kworker.0 00000100:00100000:2.0:1787432754.934007:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812796800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432754.934113:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432754.934220:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812796800 00000100:00100000:2.0:1787432754.934230:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812796800 00000100:00100000:2.0:1787432754.934296:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787432754.934308:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812796800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432754.934359:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432754.934409:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812796800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432754.934417:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787432754.934834:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812796800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432754.938153:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812796928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432754.938250:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432754.938339:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812796928 00000100:00100000:0.0:1787432754.938350:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812796928 00000100:00100000:0.0:1787432754.938404:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787432754.938414:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812796928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432754.938456:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787432754.938510:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812796928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432754.938517:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1787432754.938593:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb9a94000 x1874258812796928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432754.938617:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812796928:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787432755.019588:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:1.0:1787432755.303391:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432755.307436:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791786624 00000100:00100000:3.0:1787432755.307456:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791786624 00000100:00100000:3.0:1787432755.307561:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:3.0:1787432755.307576:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+8:10312:x1874258791786624:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432755.307603:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432755.307631:0:6929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fd19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c00 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.307751:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.307768:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.307783:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.307798:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fd27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.307804:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fd27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.307810:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fd27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.308156:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.308167:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd20 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.308174:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.308181:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2166000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432755.308186:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.308207:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.308222:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b952e8200) 00010000:00010000:3.0:1787432755.308225:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432755.308231:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.308237:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.308253:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fd27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.308260:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fd27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.308266:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fd27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787432755.308503:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787432755.308547:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2167200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432755.308551:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fd27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.308558:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fd27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.308566:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff935b8304a900) 00010000:00010000:3.0:1787432755.308569:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432755.308571:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fd27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.308586:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fd27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.308629:0:6929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fd19 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c00 expref: 9 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.308639:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b952e8200) 00010000:00010000:3.0:1787432755.308641:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432755.308645:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fd19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c00 expref: 9 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.308653:0:6929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2167400, rc 0) 00000100:00100000:3.0:1787432755.309613:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+8:10312:x1874258791786624:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 2035us (6340us total) trans 0 rc 301/301 00000100:00100000:3.0:1787432755.309625:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 36 00010000:00010000:2.0:1787432755.327230:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432755.335142:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432755.335278:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791786880 00000100:00100000:2.0:1787432755.335293:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791786880 00000100:00100000:2.0:1787432755.335377:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:2.0:1787432755.335390:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+8:10312:x1874258791786880:12345-192.168.202.15@tcp:36:lfs.0 00010000:00010000:2.0:1787432755.335471:0:8110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432755.335506:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f0fcd3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025beb expref: 8 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.335553:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b952e8200) 00010000:00010000:2.0:1787432755.335568:0:8110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432755.338093:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0fd2e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.338120:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0fd2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.338135:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0fd2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.338150:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fd35 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.338157:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fd35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.338163:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fd35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432755.342058:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787432755.342084:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0fd2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.342098:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0fd2e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.342106:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0fd2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.342113:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432755.342128:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0fd2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.342137:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0fd2e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.342160:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b952e8600) 00010000:00010000:2.0:1787432755.342163:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432755.342168:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0fd2e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.342175:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0fd2e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432755.342205:0:8110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae88cca4 reply state 0000000057fb7553 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fd35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432755.342216:0:8110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787432755.342380:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+9:10312:x1874258791786880:12345-192.168.202.15@tcp:36:lfs.0 Request processed in 6986us (7247us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787432755.342390:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 37 00010000:00010000:1.0:1787432755.365086:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fd35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432755.365111:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fd35 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432755.365121:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fd35 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432755.365128:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432755.365135:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fd35 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432755.365145:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fd35 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432755.365171:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff935b952e8900) 00010000:00010000:1.0:1787432755.365175:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432755.365181:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fd35 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432755.365189:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0fd35 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432755.469564:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432755.469867:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791787008 00000100:00100000:3.0:1787432755.469883:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791787008 00000100:00100000:3.0:1787432755.469988:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:3.0:1787432755.470002:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+8:10320:x1874258791787008:12345-192.168.202.15@tcp:101:lctl.0 00010000:00010000:3.0:1787432755.470033:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432755.470062:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fd3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c07 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.470153:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fd43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.470171:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fd43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.470205:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fd43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432755.470582:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787432755.470589:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432755.470690:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fd43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.470740:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fd3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c07 expref: 10 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.470767:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fd43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c07 expref: 9 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.470778:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a900) 00010000:00010000:3.0:1787432755.470781:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432755.470785:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2167200, rc 0) 00000100:00100000:3.0:1787432755.470881:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+9:10320:x1874258791787008:12345-192.168.202.15@tcp:101:lctl.0 Request processed in 881us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432755.470889:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:0.0:1787432755.583517:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432755.583728:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791787136 00000100:00100000:3.0:1787432755.583743:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791787136 00000100:00100000:3.0:1787432755.583884:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:3.0:1787432755.583898:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+9:10326:x1874258791787136:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:3.0:1787432755.583935:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432755.583964:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fd4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c0e expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584090:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584107:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584122:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584142:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fd58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584150:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fd58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584158:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fd58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584325:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154e00/0xbcb9e331c3f0fd5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584334:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154e00/0xbcb9e331c3f0fd5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584342:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154e00/0xbcb9e331c3f0fd5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432755.584379:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787432755.584384:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432755.584436:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154e00/0xbcb9e331c3f0fd5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584463:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584470:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd51 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584477:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584483:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2166000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432755.584488:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584497:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584511:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a900) 00010000:00010000:3.0:1787432755.584515:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432755.584520:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584526:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2166000/0xbcb9e331c3f0fd51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584543:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fd58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584550:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fd58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584556:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fd58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584567:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432755.584570:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fd58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584576:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fd58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584584:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff935b8304ab00) 00010000:00010000:3.0:1787432755.584586:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432755.584589:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fd58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584594:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fd58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584634:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167400/0xbcb9e331c3f0fd4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c0e expref: 11 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584650:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154e00/0xbcb9e331c3f0fd5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c0e expref: 10 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.584741:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:3.0:1787432755.584744:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787432755.584747:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154e00, rc 0) 00000100:00100000:3.0:1787432755.584844:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+10:10326:x1874258791787136:12345-192.168.202.15@tcp:101:bash.0 Request processed in 949us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432755.584853:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:1.0:1787432755.588403:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432755.588849:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791787392 00000100:00100000:2.0:1787432755.588863:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791787392 00000100:00100000:2.0:1787432755.588951:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00100000:2.0:1787432755.588964:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+10:10326:x1874258791787392:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787432755.589002:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432755.589030:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f0fd66 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c15 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.589224:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f0fd6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.589259:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f0fd6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.589408:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f0fd6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.589429:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fd74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.589436:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fd74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.589442:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fd74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787432755.590539:0:8110:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1787432755.590809:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f0fd7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.590825:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f0fd7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.590837:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f0fd7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.590880:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f0fd6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.590888:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f0fd6d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.590895:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f0fd6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.590918:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fc00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432755.590924:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f0fd6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.590933:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f0fd6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.590949:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:2.0:1787432755.590953:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432755.590958:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f0fd6d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.590964:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f0fd6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432755.592260:0:8110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cfac2e4 reply state 000000003a3e8a76 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fd74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432755.592339:0:8110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787432755.592414:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f0fd66 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c15 expref: 13 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.592442:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f0fd7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c15 expref: 12 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.592453:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b952e8200) 00010000:00010000:2.0:1787432755.592456:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432755.592460:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f600, rc 0) 00000100:00100000:2.0:1787432755.592804:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+13:10326:x1874258791787392:12345-192.168.202.15@tcp:101:bash.0 Request processed in 3840us (4415us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787432755.592829:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 40 00010000:00010000:3.0:1787432755.604458:0:3317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fd74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.604496:0:3317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fd74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.604505:0:3317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fd74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.604512:0:3317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432755.604519:0:3317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fd74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.604936:0:3317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fd74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.604961:0:3317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff935b952e8600) 00010000:00010000:3.0:1787432755.604964:0:3317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432755.604970:0:3317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fd74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.604977:0:3317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0fd74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432755.616201:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432755.616445:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791787520 00000100:00100000:3.0:1787432755.617630:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791787520 00000100:00100000:2.0:1787432755.621537:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:2.0:1787432755.621549:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2374:x1874258791787520:12345-192.168.202.15@tcp:8:bash.0 00010000:00080000:2.0:1787432755.621584:0:6725:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp t0 exp 0000000000000000 cur 390 last 0 00000020:00000080:2.0:1787432755.621621:0:6725:0:(genops.c:1385:class_connect()) connect: client ee8b542c-0113-490f-a721-62606ee0807f, cookie 0xbcb9e331c3f0fd89 00002000:00100000:2.0:1787432755.621633:0:6725:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ee8b542c-0113-490f-a721-62606ee0807f/ffff935a8782e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787432755.621643:0:6725:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787432755.622206:0:6725:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787432755.622243:0:6725:0:(import.c:65:import_set_state_nolock()) ffff935a8782a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432755.622481:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2374:x1874258791787520:12345-192.168.202.15@tcp:8:bash.0 Request processed in 930us (6286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432755.622490:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:2.0:1787432755.629825:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432755.630279:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791787648 00000100:00100000:3.0:1787432755.630291:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791787648 00000100:00100000:3.0:1787432755.630398:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:3.0:1787432755.630409:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:0:x1874258791787648:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:3.0:1787432755.630426:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432755.630460:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f672b318/0xbcb9e331c3f0fd90 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c1c expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432755.630502:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432755.630859:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1787432755.630864:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432755.630874:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f672b318/0xbcb9e331c3f0fd90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c1c expref: 7 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.630896:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f672b318/0xbcb9e331c3f0fd90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c1c expref: 7 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.630920:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155600, rc 0) 00000100:00100000:3.0:1787432755.630975:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+7:0:x1874258791787648:12345-192.168.202.15@tcp:101:bash.0 Request processed in 568us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432755.630982:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00080000:0.0:1787432755.632223:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432755.645406:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432755.645510:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791787776 00000100:00100000:3.0:1787432755.645524:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791787776 00000100:00100000:3.0:1787432755.645653:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:3.0:1787432755.645706:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+7:10326:x1874258791787776:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:3.0:1787432755.645730:0:6726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432755.645754:0:6726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f0fd97 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c23 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.645797:0:6726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f672b318/0xbcb9e331c3f0fd90 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c1c expref: 8 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.645808:0:6726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432755.645840:0:6726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432755.645848:0:6726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f0fd97 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c23 expref: 8 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.645915:0:6726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f672b318/0xbcb9e331c3f0fd90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c1c expref: 8 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.645933:0:6726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f672b318/0xbcb9e331c3f0fd90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c1c expref: 8 pid: 8446 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432755.645950:0:6726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa61c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6726:1874258812797056:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787432755.646082:0:6726:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b8d3bb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432755.654413:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432755.654518:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791787904 00000100:00100000:0.0:1787432755.654531:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791787904 00010000:00010000:0.0:1787432755.654586:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f672b318/0xbcb9e331c3f0fd90 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c1c expref: 9 pid: 8446 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432755.654634:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:0.0:1787432755.654645:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+9:2375:x1874258791787904:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432755.654703:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432755.654734:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f672b318/0xbcb9e331c3f0fd90 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c1c expref: 9 pid: 8446 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432755.654751:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f672b318/0xbcb9e331c3f0fd90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c1c expref: 9 pid: 8446 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432755.654787:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432755.654793:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432755.654804:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f0fd97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c23 expref: 9 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432755.654840:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f0fd97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c23 expref: 9 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432755.655046:0:5853:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f0fd97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c23 expref: 9 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432755.655066:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a95500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5853:1874258812797184:192.168.202.15@tcp:105: 00000100:00100000:0.0:1787432755.655171:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91fa3300 going to sleep for 11 seconds 00010000:00010000:3.0:1787432755.655552:0:6726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f672b318/0xbcb9e331c3f0fd90 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c1c expref: 9 pid: 8446 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432755.655571:0:6726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa61c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6726:1874258812797056:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787432755.655604:0:6726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f0fd97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025c23 expref: 8 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.655617:0:6726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154600, rc 0) 00000100:00100000:3.0:1787432755.655650:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+8:10326:x1874258791787776:12345-192.168.202.15@tcp:101:bash.0 Request processed in 9947us (10261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432755.655710:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:1.0:1787432755.663557:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432755.663767:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a95500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5853:1874258812797184:192.168.202.15@tcp:105: 00010000:00010000:0.0:1787432755.663801:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432755.663878:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+7:2375:x1874258791787904:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 9234us (9479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432755.663901:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:2.0:1787432755.664128:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791788160 00000100:00100000:2.0:1787432755.664138:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791788160 00000100:00100000:2.0:1787432755.664210:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:2.0:1787432755.664222:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+12:10326:x1874258791788160:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:2.0:1787432755.664654:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+13:10326:x1874258791788160:12345-192.168.202.15@tcp:35:bash.0 Request processed in 432us (1111us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787432755.664711:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:2.0:1787432755.761298:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432755.761458:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791788416 00000100:00100000:3.0:1787432755.761470:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791788416 00000100:00100000:3.0:1787432755.761556:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:3.0:1787432755.761587:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+13:10336:x1874258791788416:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432755.761620:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432755.761648:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fd9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c2a expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432755.761858:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787432755.762258:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fd9e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c2a expref: 15 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.762277:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a900) 00010000:00010000:3.0:1787432755.762280:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432755.762285:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fd9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c2a expref: 15 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.762305:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155600, rc 0) 00000100:00100000:3.0:1787432755.763069:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+14:10336:x1874258791788416:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1480us (1780us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1787432755.763080:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:1.0:1787432755.769588:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432755.771042:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791788672 00000100:00100000:2.0:1787432755.771063:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791788672 00000100:00100000:2.0:1787432755.771141:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:2.0:1787432755.771172:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+14:10336:x1874258791788672:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787432755.771532:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+15:10336:x1874258791788672:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 361us (1960us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787432755.771541:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:2.0:1787432755.888081:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432755.888192:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791788800 00000100:00100000:3.0:1787432755.888205:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791788800 00000100:00100000:3.0:1787432755.888282:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:3.0:1787432755.888294:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+15:10342:x1874258791788800:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432755.888329:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432755.888358:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fdac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c31 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.888446:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0fdb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.888477:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0fdb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.888490:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0fdb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432755.888756:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787432755.888761:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432755.888789:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0fdb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.888822:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fdac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c31 expref: 17 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.888845:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0fdb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c31 expref: 16 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.888856:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:3.0:1787432755.888859:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432755.888863:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154000, rc 0) 00000100:00100000:3.0:1787432755.889065:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+16:10342:x1874258791788800:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 772us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432755.889075:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:0.0:1787432755.898467:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432755.898598:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791789056 00000100:00100000:2.0:1787432755.898610:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791789056 00000100:00100000:2.0:1787432755.898695:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:2.0:1787432755.898707:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+16:10342:x1874258791789056:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787432755.898728:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432755.898750:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fdba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c38 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.898864:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f0fdc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.898879:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f0fdc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.899221:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f0fdc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432755.899237:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787432755.899380:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fdba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c38 expref: 19 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.899400:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f0fdc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c38 expref: 18 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432755.899427:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b952e8200) 00010000:00010000:2.0:1787432755.899430:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432755.899434:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e400, rc 0) 00000100:00100000:2.0:1787432755.899505:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+18:10342:x1874258791789056:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 800us (1049us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787432755.899523:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:1.0:1787432755.903801:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432755.905307:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791789312 00000100:00100000:3.0:1787432755.905321:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791789312 00000100:00100000:3.0:1787432755.905386:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:3.0:1787432755.905396:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+18:10342:x1874258791789312:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432755.905420:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432755.905456:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fdcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c3f expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.905560:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f0fdd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.905575:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f0fdd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.905587:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f0fdd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432755.905600:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787432755.905743:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fdcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c3f expref: 21 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.905763:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f0fdd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c3f expref: 20 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.905773:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b952e8200) 00010000:00010000:3.0:1787432755.905776:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787432755.905780:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154a00, rc 0) 00000100:00100000:3.0:1787432755.905865:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+20:10342:x1874258791789312:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 470us (2073us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787432755.905873:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:3.0:1787432755.909601:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432755.913591:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791789440 00000100:00100000:0.0:1787432755.913608:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791789440 00000100:00100000:0.0:1787432755.914245:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:0.0:1787432755.914259:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+20:2377:x1874258791789440:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432755.914278:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432755.914305:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f0fdc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c38 expref: 20 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432755.914325:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b952e8200) 00010000:00010000:0.0:1787432755.914330:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432755.914411:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+19:2377:x1874258791789440:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 156us (4820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432755.914419:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:1.0:1787432755.916577:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432755.916694:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791789568 00000100:00100000:3.0:1787432755.916703:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791789568 00000100:00100000:3.0:1787432755.916753:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:3.0:1787432755.916764:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+7:2375:x1874258791789568:12345-192.168.202.15@tcp:1:lfs.0 00010000:00010000:3.0:1787432755.916834:0:8446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f0fde4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.916854:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f0fd97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025c23 expref: 7 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.916862:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432755.916866:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787432755.916871:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f0fde4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.916938:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f0fd97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x93816182a025c23 expref: 7 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.916953:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f0fd97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025c23 expref: 7 pid: 6726 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432755.916967:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa62680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8446:1874258812797312:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787432755.917060:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba81a840 going to sleep for 11 seconds 00000100:00100000:3.0:1787432755.923159:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa62680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8446:1874258812797312:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787432755.923191:0:8446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f0fde4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432755.932834:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432755.933693:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791789696 00000100:00100000:3.0:1787432755.933704:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791789696 00002000:00100000:3.0:1787432755.933758:0:6729:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff935bbb5b9880 x1874258791789696/t0(0) o4->ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp:466/0 lens 504/0 e 0 to 0 dl 1787432766 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787432755.933781:0:6729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935bbb5b9880 with x1874258791789696 ext(0->12) 00010000:00010000:3.0:1787432755.933791:0:6729:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f0fd97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025c23 expref: 8 pid: 6726 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.933809:0:6729:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f0fd97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025c23 expref: 8 pid: 6726 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432755.933816:0:6729:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff935bbb5b9880 00000100:00100000:3.0:1787432755.933845:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:3.0:1787432755.933855:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ee8b542c-0113-490f-a721-62606ee0807f+8:2376:x1874258791789696:12345-192.168.202.15@tcp:4:lfs.0 00000001:00100000:0.0:1787432755.996147:0:6749:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ee8b542c-0113-490f-a721-62606ee0807f 00000100:00100000:3.0:1787432755.998077:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ee8b542c-0113-490f-a721-62606ee0807f+9:2376:x1874258791789696:12345-192.168.202.15@tcp:4:lfs.0 Request processed in 64209us (65244us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787432755.998097:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00002000:00100000:3.0:1787432755.998118:0:6729:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff935bbb5b9880 x1874258791789696/t4294967299(0) o4->ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp:466/0 lens 504/448 e 0 to 0 dl 1787432766 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787432755.998130:0:6729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935bbb5b9880 with x1874258791789696 ext(0->12) 00010000:00010000:3.0:1787432755.998144:0:6729:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f0fd97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025c23 expref: 9 pid: 6726 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432755.998172:0:6729:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f0fd97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025c23 expref: 9 pid: 6726 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432755.998181:0:6729:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff935bbb5b9880 00000100:00100000:1.0:1787432756.005086:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432756.005193:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791789824 00000100:00100000:2.0:1787432756.005212:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791789824 00010000:00010000:2.0:1787432756.005267:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f0fd97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025c23 expref: 9 pid: 6726 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432756.005320:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:2.0:1787432756.005332:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+9:2378:x1874258791789824:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432756.005350:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787432756.005373:0:5851:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787432756.005377:0:5851:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787432755 00002000:00010000:2.0:1787432756.005379:0:5851:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787432756 00002000:00010000:2.0:1787432756.005381:0:5851:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787432755 00010000:00010000:2.0:1787432756.005387:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f0fd97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025c23 expref: 9 pid: 6726 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.005402:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f0fd97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025c23 expref: 9 pid: 6726 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.005428:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f0fd97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025c23 expref: 9 pid: 6726 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.005465:0:5851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432756.005470:0:5851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432756.005477:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f0fde4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.005487:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f0fde4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.005520:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432756.005588:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+8:2378:x1874258791789824:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 257us (515us total) trans 0 rc 0/0 00010000:00010000:3.0:1787432756.005591:0:8446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f0fde4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432756.005598:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 36 00010000:00010000:3.0:1787432756.006142:0:8446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f0fde4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432756.006187:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f0fde4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432756.006196:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f0fde4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432756.006205:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f0fde4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432756.006213:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155000 already unused, calling callback (ffffffffc1752230) 00010000:00010000:3.0:1787432756.006218:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f0fde4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432756.006226:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f0fde4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432756.006247:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f0fde4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432756.006257:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f0fde4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432756.006628:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+7:2375:x1874258791789568:12345-192.168.202.15@tcp:1:lfs.0 Request processed in 89861us (90055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432756.006640:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:1.0:1787432756.033497:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432756.033642:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791790080 00000100:00100000:0.0:1787432756.033703:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791790080 00000100:00100000:0.0:1787432756.033780:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:0.0:1787432756.033793:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+19:10342:x1874258791790080:12345-192.168.202.15@tcp:35:lfs.0 00000004:00010000:0.0:1787432756.033881:0:5870:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f0fdd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c3f expref: 19 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787432756.034298:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1787432756.034358:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1787432756.035225:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787432756.035309:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f0fdeb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432756.035333:0:5870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f0fd7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c15 expref: 23 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432756.035344:0:5870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f0fdeb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432756.035394:0:5870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f0fd7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c15 expref: 23 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432756.035413:0:5870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f0fd7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c15 expref: 23 pid: 8110 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432756.035445:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a97b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5870:1874258812797440:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787432756.035582:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91679300 going to sleep for 11 seconds 00000100:00100000:1.0:1787432756.039154:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432756.039467:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791790208 00000100:00100000:2.0:1787432756.039478:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791790208 00010000:00010000:2.0:1787432756.039522:0:8489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f0fd7b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c15 expref: 24 pid: 8110 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432756.039570:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:2.0:1787432756.039581:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+24:2376:x1874258791790208:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432756.039596:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432756.039604:0:8489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f0fd7b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c15 expref: 24 pid: 8110 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.039618:0:8489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f0fd7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c15 expref: 24 pid: 8110 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.039697:0:8489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b952e8200) 00010000:00010000:2.0:1787432756.039703:0:8489:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f0fdeb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.039713:0:8489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f0fdeb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.039721:0:8489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f0fdeb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.039741:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432756.039792:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+24:2376:x1874258791790208:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 212us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432756.039800:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 37 00010000:00010000:0.0:1787432756.040711:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f0fd7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c15 expref: 23 pid: 8110 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432756.040751:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a97b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5870:1874258812797440:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787432756.040786:0:5870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f0fdeb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432756.040799:0:5870:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f0fdeb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432756.040805:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f0fdeb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787432756.040999:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787432756.042795:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1787432756.043086:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a97b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5870:1874258812797568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787432756.046300:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432756.046359:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91679a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432756.046399:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812797568 00000100:00100000:1.0:1787432756.046416:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812797568 00000100:00100000:1.0:1787432756.046517:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432756.046530:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5870:x1874258812797568:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787432756.046748:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5870:x1874258812797568:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 220us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432756.046757:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787432756.047238:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787432756.049257:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a97b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5870:1874258812797568:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787432756.053358:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787432756.053473:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae5b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5870:1874258812797696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787432756.053545:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432756.053577:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b874e8480 going to sleep for 11 seconds 00000100:00100000:1.0:1787432756.053943:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812797696 00000100:00100000:1.0:1787432756.053951:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812797696 00000100:00100000:1.0:1787432756.054022:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787432756.054033:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5870:x1874258812797696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787432756.054240:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5870:x1874258812797696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 209us (694us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787432756.054248:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432756.054571:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae5b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5870:1874258812797696:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787432756.054639:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1787432756.054736:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f0fdeb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.054751:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f0fdeb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.054760:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f0fdeb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.054776:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432756.054782:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f0fdeb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.054792:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f0fdeb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.054809:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b952e8200) 00010000:00010000:2.0:1787432756.054813:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787432756.054832:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f0fdeb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.054838:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f0fdeb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787432756.055202:0:5870:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787432756.055444:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787432756.055456:0:5870:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 390720797968ns, next at 391720796008ns, rc = 0 00000001:00080000:2.0:1787432756.055464:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1787432756.055500:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b952e8200) 00010000:00010000:2.0:1787432756.055504:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787432756.055512:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f0fdd6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c3f expref: 27 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432756.055627:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+26:10342:x1874258791790080:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 21836us (22145us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787432756.055636:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000020:00080000:2.0:1787432756.055642:0:5870:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787432756.060049:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432756.060183:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791790336 00000100:00100000:3.0:1787432756.060197:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791790336 00000100:00100000:3.0:1787432756.060288:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:3.0:1787432756.060304:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+26:10342:x1874258791790336:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432756.060343:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432756.060378:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155000/0xbcb9e331c3f0fdf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c46 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432756.060467:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155000/0xbcb9e331c3f0fdf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c46 expref: 27 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432756.060486:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155000/0xbcb9e331c3f0fdf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c46 expref: 27 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432756.060511:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:3.0:1787432756.060515:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787432756.060520:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155000, rc 0) 00000100:00100000:3.0:1787432756.060604:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+27:10342:x1874258791790336:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 303us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432756.060612:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:0.0:1787432756.063504:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432756.063945:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791790592 00000100:00100000:2.0:1787432756.063956:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791790592 00000100:00100000:2.0:1787432756.064103:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:2.0:1787432756.064114:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b835a0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+27:10342:x1874258791790592:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787432756.064371:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b835a0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+28:10342:x1874258791790592:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 258us (879us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787432756.064378:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:1.0:1787432756.149193:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432756.149326:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432756.149467:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791790848 00000100:00100000:2.0:1787432756.149480:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791790848 00000100:00100000:0.0:1787432756.149556:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791790720 00000100:00100000:0.0:1787432756.149560:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791790720 00000100:00100000:0.0:1787432756.149633:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 288 00000100:00100000:0.0:1787432756.149643:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2377:x1874258791790720:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787432756.150097:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 139 00000100:00100000:2.0:1787432756.150107:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2377:x1874258791790848:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432756.150362:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2377:x1874258791790720:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 718us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432756.150372:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 288 00000100:00080000:1.0:1787432756.150773:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432756.151247:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2377:x1874258791790848:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 1137us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432756.151257:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 139 00000100:00100000:1.0:1787432756.182272:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432756.182458:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791791104 00000100:00100000:0.0:1787432756.182471:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791791104 00000100:00100000:0.0:1787432756.182564:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:0.0:1787432756.182577:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+28:10352:x1874258791791104:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787432756.182620:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432756.182650:0:6929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f0fdf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c4d expref: -99 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432756.182861:0:6929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787432756.183042:0:6929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f0fdf9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c4d expref: 30 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432756.183060:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a900) 00010000:00010000:0.0:1787432756.183064:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787432756.183070:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f0fdf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c4d expref: 30 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432756.183089:0:6929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80031400, rc 0) 00000100:00100000:0.0:1787432756.184018:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+29:10352:x1874258791791104:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1434us (1752us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1787432756.184032:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:3.0:1787432756.188967:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432756.189054:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791791232 00000100:00100000:2.0:1787432756.189068:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791791232 00000100:00100000:2.0:1787432756.189147:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:2.0:1787432756.189160:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+29:10352:x1874258791791232:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:2.0:1787432756.189278:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189301:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189317:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189336:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189363:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189371:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189507:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f0fe15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189529:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f0fe15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189538:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f0fe15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432756.189594:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f0fe15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189620:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189629:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe07 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189637:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189646:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fa00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432756.189651:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189689:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe07 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189712:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:2.0:1787432756.189716:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432756.189722:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189731:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189748:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189756:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189763:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189769:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432756.189772:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189779:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189787:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff935b952e8200) 00010000:00010000:2.0:1787432756.189790:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432756.189793:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189799:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189829:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f0fe15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189836:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f0fe15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189843:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f0fe15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189849:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432756.189852:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f0fe15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189859:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f0fe15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189867:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:2.0:1787432756.189870:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432756.189874:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f0fe15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.189880:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f0fe15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432756.190573:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+29:10352:x1874258791791232:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 1410us (1620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432756.190584:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:3.0:1787432756.192942:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432756.193048:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791791488 00000100:00100000:2.0:1787432756.193061:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791791488 00000100:00100000:2.0:1787432756.193132:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:2.0:1787432756.193152:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+29:10352:x1874258791791488:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787432756.193500:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+30:10352:x1874258791791488:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 349us (572us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787432756.193509:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:1.0:1787432756.252376:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432756.252500:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791791744 00000100:00100000:2.0:1787432756.253632:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791791744 00000100:00100000:2.0:1787432756.253820:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:2.0:1787432756.253834:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+30:10355:x1874258791791744:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787432756.253868:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432756.254091:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f0fe1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c54 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.254195:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.254214:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.254228:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.254245:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.254252:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.254260:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.254448:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f0fe31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.254458:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f0fe31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.254464:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f0fe31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432756.254476:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787432756.254742:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.254751:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe23 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.254759:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.254767:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432756.254772:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.254782:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.254797:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:2.0:1787432756.254800:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432756.254807:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.255153:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.255171:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.255177:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.255184:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.255189:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fa00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432756.255192:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.255198:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.255207:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff935b952e8200) 00010000:00010000:2.0:1787432756.255210:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432756.255213:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.255218:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.255281:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f0fe1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c54 expref: 33 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.255297:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f0fe31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c54 expref: 32 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.255311:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:2.0:1787432756.255314:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432756.255316:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f800, rc 0) 00000100:00100000:2.0:1787432756.255480:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+32:10355:x1874258791791744:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1647us (3119us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787432756.255489:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:3.0:1787432756.260249:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432756.260417:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791791872 00000100:00100000:2.0:1787432756.260431:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791791872 00000100:00100000:2.0:1787432756.260737:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:2.0:1787432756.260750:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+32:10355:x1874258791791872:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:2.0:1787432756.260867:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fe3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.260898:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fe3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.260922:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fe3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.260958:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fe3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.260966:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fe3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.260974:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fe3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.260982:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fe00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432756.261001:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fe3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.261011:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fe3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.261028:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:2.0:1787432756.261032:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787432756.261038:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fe3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.261045:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fe3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432756.261159:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+32:10355:x1874258791791872:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 410us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432756.261168:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:1.0:1787432756.263780:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432756.264038:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791792128 00000100:00100000:0.0:1787432756.264051:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791792128 00000100:00100000:0.0:1787432756.264331:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:0.0:1787432756.264354:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+32:10355:x1874258791792128:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:0.0:1787432756.264696:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+33:10355:x1874258791792128:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 343us (929us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787432756.264704:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00010000:00010000:2.0:1787432756.341913:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432756.562740:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432756.563349:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791792384 00000100:00100000:2.0:1787432756.563364:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791792384 00000100:00100000:2.0:1787432756.563450:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:2.0:1787432756.563462:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+33:10386:x1874258791792384:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:2.0:1787432756.563486:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432756.563508:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fe46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c5b expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.563612:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f0fe4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.563626:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f0fe4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.563718:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f0fe4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432756.563732:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787432756.563887:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fe46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c5b expref: 36 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.563916:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f0fe4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c5b expref: 35 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.563925:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:2.0:1787432756.563928:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432756.563932:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f000, rc 0) 00000100:00100000:2.0:1787432756.564002:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+35:10386:x1874258791792384:12345-192.168.202.15@tcp:101:cat.0 Request processed in 542us (1278us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787432756.564010:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:1.0:1787432756.568606:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432756.568713:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791792640 00000100:00100000:3.0:1787432756.568727:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791792640 00000100:00100000:3.0:1787432756.568806:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:3.0:1787432756.568828:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+35:10386:x1874258791792640:12345-192.168.202.15@tcp:35:cat.0 00000100:00100000:3.0:1787432756.569284:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+36:10386:x1874258791792640:12345-192.168.202.15@tcp:35:cat.0 Request processed in 457us (692us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1787432756.569293:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:1.0:1787432756.577336:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432756.577489:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791792768 00000100:00100000:0.0:1787432756.577502:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791792768 00000100:00100000:0.0:1787432756.577602:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:0.0:1787432756.577614:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935ba07d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+36:2377:x1874258791792768:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432756.577634:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432756.577693:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f0fe4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c5b expref: 36 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432756.577721:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:0.0:1787432756.577729:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432756.577805:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935ba07d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+35:2377:x1874258791792768:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 192us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432756.579095:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:1.0:1787432756.629300:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432756.629427:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791793024 00000100:00100000:2.0:1787432756.629440:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791793024 00000100:00100000:2.0:1787432756.629515:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:2.0:1787432756.629529:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+35:10392:x1874258791793024:12345-192.168.202.15@tcp:101:dd.0 00010000:00010000:2.0:1787432756.629562:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432756.629565:0:5869:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787432756.629603:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0fdb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c31 expref: 35 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.629629:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:2.0:1787432756.629636:0:5869:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432756.629733:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fe5b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c62 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.629870:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.629887:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f0fe31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c54 expref: 35 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.629907:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe62 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.629950:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f0fe31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c54 expref: 35 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.629966:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f0fe31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c54 expref: 35 pid: 5869 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432756.629982:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbae59880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5869:1874258812797824:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432756.630114:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b987cc840 going to sleep for 11 seconds 00000100:00100000:2.0:1787432756.636337:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbae59880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5869:1874258812797824:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787432756.636337:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:2.0:1787432756.636373:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432756.637048:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791793152 00000100:00100000:3.0:1787432756.637058:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791793152 00010000:00010000:3.0:1787432756.637111:0:8489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f0fe31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c54 expref: 36 pid: 5869 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432756.637216:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:3.0:1787432756.637228:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+36:2375:x1874258791793152:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432756.637248:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432756.637258:0:8489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f0fe31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c54 expref: 36 pid: 5869 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432756.637273:0:8489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f0fe31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c54 expref: 36 pid: 5869 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432756.637302:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f0fe31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c54 expref: 36 pid: 5869 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432756.637323:0:8489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:3.0:1787432756.637346:0:8489:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432756.637359:0:8489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432756.637368:0:8489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe62 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432756.637398:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432756.637474:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+35:2375:x1874258791793152:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 248us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432756.637484:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 38 00010000:00010000:2.0:1787432756.637562:0:5869:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.637571:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432756.637605:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787432756.637842:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fe5b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c62 expref: 36 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.637862:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c62 expref: 35 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.637870:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:2.0:1787432756.637873:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787432756.637876:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5fa00, rc 0) 00000100:00100000:2.0:1787432756.637931:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+35:10392:x1874258791793024:12345-192.168.202.15@tcp:101:dd.0 Request processed in 8405us (8645us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787432756.637939:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:1.0:1787432756.641283:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432756.644202:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791793408 00000100:00100000:2.0:1787432756.644225:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791793408 00000100:00100000:2.0:1787432756.644320:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:2.0:1787432756.644332:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+35:10392:x1874258791793408:12345-192.168.202.15@tcp:36:dd.0 00010000:00010000:2.0:1787432756.644705:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.644731:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432756.644743:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787432756.644794:0:8110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1787432756.644839:0:8110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c29ab630 reply state 00000000ad64b31d transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432756.644849:0:8110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787432756.644990:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+38:10392:x1874258791793408:12345-192.168.202.15@tcp:36:dd.0 Request processed in 658us (3718us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787432756.644999:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 52 00000020:00080000:2.0:1787432756.645005:0:8110:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787432756.651244:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432756.651268:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432756.651277:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432756.651284:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432756.651290:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432756.651316:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432756.651337:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:0.0:1787432756.651340:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432756.651345:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432756.651351:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0fe70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432757.029258:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432757.029406:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791793536 00000100:00100000:0.0:1787432757.029420:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791793536 00000100:00100000:0.0:1787432757.029541:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:0.0:1787432757.029555:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+37:10406:x1874258791793536:12345-192.168.202.15@tcp:101:stat.0 00010000:00010000:0.0:1787432757.029591:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432757.029619:0:6929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f0fe77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c69 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.029763:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f0fe7e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.029782:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f0fe7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.029796:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f0fe7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.029815:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fe85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.029846:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fe85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.029853:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fe85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.030258:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f0fe8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.030274:0:6929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe62 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c62 expref: 38 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.030282:0:6929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f0fe8c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.030330:0:6929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c62 expref: 38 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.030349:0:6929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c62 expref: 38 pid: 5869 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432757.030366:0:6929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6929:1874258812797952:192.168.202.15@tcp:104: 00000100:00080000:1.0:1787432757.030512:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432757.031267:0:6929:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91679300 going to sleep for 11 seconds 00000100:00100000:1.0:1787432757.045037:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432757.045539:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791793792 00000100:00100000:3.0:1787432757.045553:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791793792 00000100:00100000:3.0:1787432757.045649:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:3.0:1787432757.045725:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+39:5616:x1874258791793792:12345-192.168.202.15@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787432757.046247:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+40:5616:x1874258791793792:12345-192.168.202.15@tcp:35:ldlm_bl.0 Request processed in 586us (1225us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1787432757.046258:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:0.0:1787432757.046940:0:6929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6929:1874258812797952:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787432757.046975:0:6929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f0fe8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432757.048918:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432757.052346:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791793920 00000100:00100000:2.0:1787432757.052636:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791793920 00010000:00010000:2.0:1787432757.052735:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c62 expref: 40 pid: 5869 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432757.052801:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:2.0:1787432757.052814:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+40:2375:x1874258791793920:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432757.052838:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432757.052845:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c62 expref: 40 pid: 5869 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.052859:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c62 expref: 40 pid: 5869 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.052883:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c62 expref: 40 pid: 5869 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.052914:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:2.0:1787432757.052925:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f0fe8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.052959:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f0fe8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.052967:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f0fe8c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.053017:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432757.053189:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+39:2375:x1874258791793920:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 376us (4293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432757.053198:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 39 00010000:00010000:3.0:1787432757.053357:0:6929:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f0fe8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.053366:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f0fe8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432757.053446:0:6929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787432757.053452:0:6929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432757.053701:0:6929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f0fe8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.053746:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f0fe8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.053759:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f0fe7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.053767:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f0fe7e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.053774:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f0fe7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.053782:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031c00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432757.053788:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f0fe7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.053796:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f0fe7e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.053810:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:3.0:1787432757.053813:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432757.053818:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f0fe7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.053825:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f0fe7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.053842:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fe85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.053849:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fe85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.053863:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fe85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.053868:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432757.053872:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fe85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.053879:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fe85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.053888:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff935b9838fc00) 00010000:00010000:3.0:1787432757.053891:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432757.053905:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fe85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.053911:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f0fe85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.053965:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f0fe77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c69 expref: 39 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.053981:0:6929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f0fe8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c69 expref: 38 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.053989:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:3.0:1787432757.053991:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432757.053994:0:6929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cf800, rc 0) 00000100:00100000:3.0:1787432757.054039:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+38:10406:x1874258791793536:12345-192.168.202.15@tcp:101:stat.0 Request processed in 24488us (24800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432757.054057:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:1.0:1787432757.145488:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432757.148671:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791794176 00000100:00100000:2.0:1787432757.148693:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791794176 00000100:00100000:2.0:1787432757.148800:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 54 00000100:00100000:2.0:1787432757.148813:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+38:10412:x1874258791794176:12345-192.168.202.15@tcp:36:truncate.0 00010000:00010000:2.0:1787432757.148910:0:5869:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432757.148946:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f0fe8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c69 expref: 38 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.148977:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:2.0:1787432757.148983:0:5869:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432757.149448:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.149468:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.149481:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787432757.149574:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1787432757.149606:0:5869:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bee24f2b reply state 0000000078a2b2e8 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432757.149617:0:5869:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787432757.149861:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+40:10412:x1874258791794176:12345-192.168.202.15@tcp:36:truncate.0 Request processed in 1046us (4386us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787432757.149870:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 54 00000020:00080000:2.0:1787432757.149876:0:5869:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787432757.162461:0:3317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.162486:0:3317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.162495:0:3317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.162501:0:3317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fa00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432757.162507:0:3317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.162515:0:3317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.162539:0:3317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:3.0:1787432757.162543:0:3317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432757.162549:0:3317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.162557:0:3317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fe93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432757.344800:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432757.345122:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791794304 00000100:00100000:2.0:1787432757.345139:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791794304 00000100:00100000:2.0:1787432757.345275:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:2.0:1787432757.345289:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+39:10426:x1874258791794304:12345-192.168.202.15@tcp:101:stat.0 00010000:00010000:2.0:1787432757.345407:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432757.345439:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fe9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c70 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.345545:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f0fea1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.345563:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f0fea1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.345579:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f0fea1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.345598:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fea8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.345618:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.345626:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.345788:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0feaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.345796:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0feaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.345803:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0feaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432757.345860:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787432757.345867:0:8110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787432757.345919:0:8110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0feaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.345935:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0feaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.345945:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f0fea1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.345953:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f0fea1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.345961:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f0fea1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.345979:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432757.345986:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f0fea1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.345994:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f0fea1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.346011:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:2.0:1787432757.346015:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432757.346022:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f0fea1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.346029:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f0fea1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.346050:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.346055:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fea8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.346061:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fea8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.346066:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fa00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432757.346069:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fea8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.346076:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fea8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.346094:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff935b952e8200) 00010000:00010000:2.0:1787432757.346097:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432757.346100:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fea8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.346107:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f0fea8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.346150:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fe9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c70 expref: 41 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.346165:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0feaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c70 expref: 40 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.346174:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:2.0:1787432757.346177:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432757.346179:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e600, rc 0) 00000100:00100000:2.0:1787432757.346276:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+40:10426:x1874258791794304:12345-192.168.202.15@tcp:101:stat.0 Request processed in 989us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432757.346286:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 55 00010000:00010000:2.0:1787432757.366996:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432757.430871:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432757.431007:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791794560 00000100:00100000:3.0:1787432757.431023:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791794560 00000100:00100000:3.0:1787432757.431109:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:3.0:1787432757.431122:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+40:10436:x1874258791794560:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432757.431161:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432757.431230:0:6929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0feb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c77 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432757.431444:0:6929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787432757.431644:0:6929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0feb6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c77 expref: 42 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.431708:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a900) 00010000:00010000:3.0:1787432757.431713:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432757.431720:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0feb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c77 expref: 42 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.431738:0:6929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155600, rc 0) 00000100:00100000:3.0:1787432757.431973:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+41:10436:x1874258791794560:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 852us (1121us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1787432757.431982:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:1.0:1787432757.437202:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432757.437490:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791794816 00000100:00100000:2.0:1787432757.437505:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791794816 00000100:00100000:2.0:1787432757.437596:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:2.0:1787432757.437609:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+41:10436:x1874258791794816:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787432757.438044:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+42:10436:x1874258791794816:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 435us (866us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787432757.438074:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:0.0:1787432757.538822:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432757.539303:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791795072 00000100:00100000:3.0:1787432757.539318:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791795072 00000100:00100000:3.0:1787432757.539407:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:3.0:1787432757.539421:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+42:10442:x1874258791795072:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:3.0:1787432757.539458:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432757.539489:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fec4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c7e expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.540171:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0fecb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.540196:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0feaf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c70 expref: 43 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.540230:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0fecb lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.540289:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0feaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c70 expref: 43 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.540308:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0feaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c70 expref: 43 pid: 8110 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432757.540326:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa60380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5867:1874258812798080:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432757.544197:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87099b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432757.554160:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432757.556417:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791795200 00000100:00100000:0.0:1787432757.556444:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791795200 00010000:00010000:0.0:1787432757.556525:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0feaf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c70 expref: 44 pid: 8110 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432757.556589:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00100000:0.0:1787432757.556602:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+44:2375:x1874258791795200:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432757.556623:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432757.556631:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0feaf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c70 expref: 44 pid: 8110 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.556648:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0feaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c70 expref: 44 pid: 8110 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.556718:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:0.0:1787432757.556725:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0fecb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.556737:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0fecb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.556745:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0fecb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.556770:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432757.556877:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+44:2375:x1874258791795200:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 277us (2733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432757.556887:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 40 00010000:00010000:2.0:1787432757.559372:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f0feaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c70 expref: 43 pid: 8110 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432757.559411:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa60380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5867:1874258812798080:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787432757.559454:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0fecb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.559467:0:5867:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0fecb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.559473:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0fecb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432757.559502:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1787432757.560069:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0fec4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c7e expref: 44 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.560093:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0fecb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c7e expref: 43 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.560104:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:2.0:1787432757.560107:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787432757.560111:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155c00, rc 0) 00000100:00100000:2.0:1787432757.560268:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+43:10442:x1874258791795072:12345-192.168.202.15@tcp:101:bash.0 Request processed in 20849us (21472us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1787432757.560279:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:1.0:1787432757.563938:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432757.564072:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791795456 00000100:00100000:2.0:1787432757.564088:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791795456 00000100:00100000:2.0:1787432757.564165:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 58 00000100:00100000:2.0:1787432757.564178:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+43:10442:x1874258791795456:12345-192.168.202.15@tcp:36:bash.0 00010000:00010000:2.0:1787432757.564566:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fed9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.564587:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.564600:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787432757.564693:0:8110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787432757.564725:0:8110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fda4eac7 reply state 00000000988b40d2 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432757.564737:0:8110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787432757.564970:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+46:10442:x1874258791795456:12345-192.168.202.15@tcp:36:bash.0 Request processed in 792us (1046us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787432757.564979:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 58 00000020:00080000:2.0:1787432757.564986:0:8110:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787432757.569583:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432757.569625:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791795584 00000100:00100000:3.0:1787432757.569637:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791795584 00000100:00100000:3.0:1787432757.569738:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:3.0:1787432757.569750:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+46:10442:x1874258791795584:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:3.0:1787432757.569784:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432757.569822:0:6929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0fee0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c85 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.569959:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f0fee7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.569977:0:6929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0fecb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c7e expref: 47 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.569985:0:6929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fed9 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.570012:0:6929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f0fee7 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.570034:0:6929:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.570068:0:6929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0fecb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c7e expref: 47 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.570085:0:6929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0fecb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c7e expref: 47 pid: 5867 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432757.570100:0:6929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa60000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6929:1874258812798208:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787432757.570209:0:6929:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87099e40 going to sleep for 11 seconds 00010000:00010000:2.0:1787432757.570423:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.570434:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fed9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.570441:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fed9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.570447:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fe00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432757.570459:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fed9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.570467:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fed9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.570486:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:2.0:1787432757.570490:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432757.570492:0:3316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f0fee7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.570502:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fed9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.570508:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f0fed9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432757.577175:0:6929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa60000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6929:1874258812798208:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787432757.577218:0:6929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f0fee7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432757.578965:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432757.579429:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791795712 00000100:00100000:2.0:1787432757.579445:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791795712 00010000:00010000:2.0:1787432757.579505:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0fecb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c7e expref: 47 pid: 5867 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432757.579726:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:2.0:1787432757.579738:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+47:2376:x1874258791795712:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432757.579759:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432757.579768:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0fecb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c7e expref: 47 pid: 5867 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.579784:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0fecb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c7e expref: 47 pid: 5867 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.580014:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0fecb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025c7e expref: 47 pid: 5867 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.580034:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:2.0:1787432757.580040:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f0fee7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.580051:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f0fee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.580059:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f0fee7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432757.580103:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432757.580197:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+46:2376:x1874258791795712:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 460us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432757.580206:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 41 00010000:00010000:3.0:1787432757.582449:0:6929:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f0fee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.582471:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f0fee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432757.582553:0:6929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787432757.582559:0:6929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432757.582586:0:6929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f0fee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.582639:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0fee0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c85 expref: 46 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.582737:0:6929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f0fee7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c85 expref: 45 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.582748:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:3.0:1787432757.582751:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432757.582756:0:6929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155200, rc 0) 00000100:00100000:3.0:1787432757.582849:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+45:10442:x1874258791795584:12345-192.168.202.15@tcp:101:bash.0 Request processed in 13098us (13277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432757.582860:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:3.0:1787432757.586904:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432757.587016:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791795968 00000100:00100000:2.0:1787432757.587030:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791795968 00000100:00100000:2.0:1787432757.587179:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:2.0:1787432757.587204:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b835a2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+45:10442:x1874258791795968:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:2.0:1787432757.587549:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b835a2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+46:10442:x1874258791795968:12345-192.168.202.15@tcp:35:bash.0 Request processed in 357us (672us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787432757.587558:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:1.0:1787432757.716391:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432757.717240:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791796224 00000100:00100000:2.0:1787432757.717259:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791796224 00000100:00100000:3.0:1787432757.717484:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:3.0:1787432757.717497:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+46:10452:x1874258791796224:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432757.717731:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432757.717764:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0feee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c8c expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432757.718357:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787432757.718758:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0feee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c8c expref: 48 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.718779:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a900) 00010000:00010000:3.0:1787432757.718782:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432757.718788:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0feee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c8c expref: 48 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.719161:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154800, rc 0) 00000100:00100000:3.0:1787432757.719353:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+47:10452:x1874258791796224:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1856us (2980us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1787432757.719365:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:1.0:1787432757.724787:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432757.725202:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791796352 00000100:00100000:3.0:1787432757.725217:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791796352 00000100:00100000:3.0:1787432757.725341:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:3.0:1787432757.725355:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+47:10452:x1874258791796352:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:3.0:1787432757.725477:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0fefc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.725501:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0fefc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.725529:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0fefc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.725550:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0ff03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.725558:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0ff03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.725565:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0ff03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.725748:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.725782:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.725791:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432757.725856:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.725880:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0fefc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.725899:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0fefc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.725913:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0fefc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.725920:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432757.725925:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0fefc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.725934:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0fefc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.725949:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:3.0:1787432757.725953:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432757.725959:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0fefc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.725965:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0fefc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.725990:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0ff03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.725996:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0ff03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.726002:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0ff03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.726008:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155c00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432757.726011:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0ff03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.726017:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0ff03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.726025:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff935b8304a200) 00010000:00010000:3.0:1787432757.726415:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432757.726421:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0ff03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.726428:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0ff03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.726449:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.726456:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.726462:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.726475:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432757.726479:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.726485:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.726495:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:3.0:1787432757.726497:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432757.726500:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.726506:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432757.726776:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+47:10452:x1874258791796352:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 1419us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432757.726787:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:0.0:1787432757.735602:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432757.735723:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791796608 00000100:00100000:2.0:1787432757.735752:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791796608 00000100:00100000:2.0:1787432757.735838:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:2.0:1787432757.735852:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+47:10452:x1874258791796608:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787432757.736533:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+48:10452:x1874258791796608:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 676us (940us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787432757.736545:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:2.0:1787432757.821123:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432757.821241:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791796864 00000100:00100000:0.0:1787432757.821254:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791796864 00000100:00100000:0.0:1787432757.821322:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:0.0:1787432757.821333:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+48:10455:x1874258791796864:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787432757.821358:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432757.821380:0:6929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f0ff11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c93 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.821473:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f0ff18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.821489:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f0ff18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.821501:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f0ff18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.821517:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f0ff1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.821524:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f0ff1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.821532:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f0ff1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.821730:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f0ff26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.821739:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f0ff26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.821746:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f0ff26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432757.821756:0:6929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787432757.821900:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f0ff18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.821909:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f0ff18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.821917:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f0ff18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.821923:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cec00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432757.821930:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f0ff18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.821938:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f0ff18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.821952:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:0.0:1787432757.821956:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432757.821961:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f0ff18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.821977:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f0ff18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.821992:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f0ff1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.821998:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f0ff1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.822003:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f0ff1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.822008:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1ce400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432757.822011:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f0ff1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.822017:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f0ff1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.822024:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff935b9838f800) 00010000:00010000:0.0:1787432757.822026:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432757.822029:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f0ff1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.822033:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f0ff1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.822088:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f0ff11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c93 expref: 51 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.822103:0:6929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f0ff26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c93 expref: 50 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.822117:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:0.0:1787432757.822120:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432757.822123:0:6929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cf600, rc 0) 00000100:00100000:0.0:1787432757.822206:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+50:10455:x1874258791796864:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 873us (1092us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787432757.822214:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:1.0:1787432757.830466:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432757.830526:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432757.830647:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791797120 00000100:00100000:0.0:1787432757.830703:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791797120 00000100:00100000:0.0:1787432757.830784:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:0.0:1787432757.830795:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+50:2376:x1874258791797120:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432757.830823:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432757.830851:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f0ff26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c93 expref: 50 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432757.830869:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:0.0:1787432757.830875:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432757.830945:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+49:2376:x1874258791797120:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 152us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432757.830953:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:3.0:1787432757.831796:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791796992 00000100:00100000:3.0:1787432757.831815:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791796992 00000100:00100000:3.0:1787432757.831864:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:3.0:1787432757.831874:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+49:10455:x1874258791796992:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:3.0:1787432757.832107:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.832123:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.832144:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.832187:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.832194:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.832202:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.832209:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432757.832214:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.832222:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.832233:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:3.0:1787432757.832237:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432757.832241:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432757.832247:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432757.832310:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+49:10455:x1874258791796992:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 437us (1866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432757.832318:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:1.0:1787432757.848241:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432757.848366:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791797376 00000100:00100000:0.0:1787432757.848378:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791797376 00000100:00100000:0.0:1787432757.848437:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:0.0:1787432757.848547:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+49:10455:x1874258791797376:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787432757.852083:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+50:10455:x1874258791797376:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 3626us (3842us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787432757.852107:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:0.0:1787432758.024317:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432758.024410:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791797632 00000100:00100000:3.0:1787432758.024541:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791797632 00000100:00100000:3.0:1787432758.024653:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 64 00000100:00100000:3.0:1787432758.024707:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+50:10473:x1874258791797632:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:3.0:1787432758.024733:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432758.024756:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025c9a expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.024860:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0ff42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.024892:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0ff42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.024904:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0ff42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432758.024916:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787432758.025053:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c9a expref: 53 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.025074:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0ff42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c9a expref: 52 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.025083:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:3.0:1787432758.025086:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787432758.025098:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155c00, rc 0) 00000100:00100000:3.0:1787432758.025163:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+52:10473:x1874258791797632:12345-192.168.202.15@tcp:101:cat.0 Request processed in 459us (856us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1787432758.025171:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 64 00000100:00100000:2.0:1787432758.051288:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432758.058970:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791797760 00000100:00100000:1.0:1787432758.058986:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791797760 00000100:00100000:1.0:1787432758.059139:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 65 00000100:00100000:1.0:1787432758.059168:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+52:10474:x1874258791797760:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787432758.059197:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432758.059219:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f0ff50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025ca1 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432758.059289:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7400/0xbcb9e331c3f0ff57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432758.059303:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7400/0xbcb9e331c3f0ff57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432758.059313:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7400/0xbcb9e331c3f0ff57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432758.059375:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787432758.059379:0:8110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787432758.059403:0:8110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7400/0xbcb9e331c3f0ff57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432758.059443:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f0ff50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ca1 expref: 54 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432758.059463:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7400/0xbcb9e331c3f0ff57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ca1 expref: 53 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432758.059472:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:1.0:1787432758.059474:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787432758.059478:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e7400, rc 0) 00000100:00100000:1.0:1787432758.059553:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+53:10474:x1874258791797760:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 388us (8276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432758.059570:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 65 00000040:00080000:1.0:1787432758.070960:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787432758.072175:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432758.078275:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791798144 00000100:00100000:0.0:1787432758.078308:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791798144 00000100:00100000:1.0:1787432758.078436:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:0.0:1787432758.078628:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+53:10474:x1874258791798144:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:0.0:1787432758.079039:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+54:10474:x1874258791798144:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 591us (6872us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787432758.079048:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:0.0:1787432758.092960:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432758.094169:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791798272 00000100:00100000:1.0:1787432758.094182:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791798272 00000100:00100000:1.0:1787432758.094269:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:1.0:1787432758.094282:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+54:10474:x1874258791798272:12345-192.168.202.15@tcp:103:lfs.0 00010000:00010000:1.0:1787432758.094299:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787432758.094325:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f0fee7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c85 expref: 54 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432758.094349:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f0ff42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c9a expref: 53 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432758.094362:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155000/0xbcb9e331c3f0fdf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c46 expref: 52 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432758.094374:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:1.0:1787432758.094391:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432758.094454:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+51:10474:x1874258791798272:12345-192.168.202.15@tcp:103:lfs.0 Request processed in 175us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432758.094461:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:2.0:1787432758.100042:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432758.100123:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791798400 00000100:00100000:1.0:1787432758.100134:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791798400 00000100:00100000:1.0:1787432758.100234:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 66 00000100:00100000:1.0:1787432758.100257:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+51:10474:x1874258791798400:12345-192.168.202.15@tcp:58:lfs.0 00010000:00010000:1.0:1787432758.100387:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f0ff5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432758.100404:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f0ff5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432758.100415:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f0ff5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787432758.100757:0:5869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787432758.100976:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787432758.101060:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787432758.101161:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+51:10474:x1874258791798400:12345-192.168.202.15@tcp:58:lfs.0 Request processed in 916us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432758.101169:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 66 00000100:00100000:2.0:1787432758.140089:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432758.140203:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791798528 00000100:00100000:3.0:1787432758.140213:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791798528 00000100:00100000:3.0:1787432758.140294:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 67 00000100:00100000:3.0:1787432758.140305:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+51:10476:x1874258791798528:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432758.140328:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432758.140349:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025ca8 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.140442:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ff6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.140456:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ff6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.140467:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ff6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.140481:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0ff73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.140487:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0ff73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.140494:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0ff73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.140588:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f0ff7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.140597:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f0ff7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.140603:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f0ff7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432758.140645:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787432758.140650:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432758.140688:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f0ff7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.140700:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f0ff7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.140708:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ff6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.140714:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ff6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.140721:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ff6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.140727:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432758.140731:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ff6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.140739:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ff6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.141143:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:3.0:1787432758.141146:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432758.141151:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ff6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.141158:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ff6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.141183:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0ff73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.141190:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0ff73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.141195:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0ff73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.141200:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432758.141203:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0ff73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.141209:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0ff73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.141216:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff935b8304a200) 00010000:00010000:3.0:1787432758.141218:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432758.141220:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0ff73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.141225:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0ff73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.141256:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ca8 expref: 53 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.141269:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f0ff7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ca8 expref: 52 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432758.141286:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935ba2a69b00) 00010000:00010000:3.0:1787432758.141288:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432758.141291:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154a00, rc 0) 00000100:00100000:3.0:1787432758.141396:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+52:10476:x1874258791798528:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1092us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432758.141403:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 67 00010000:00010000:2.0:1787432758.389905:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787432759.066773:0:12042:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787432759.066783:0:12042:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787432759.066836:0:12042:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787432759.066843:0:12042:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787432759.094275:0:11725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787432759.094285:0:11725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787432759.094354:0:11725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787432759.094361:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787432759.094481:0:11725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5a4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11725:1874258812798336:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787432759.094581:0:11725:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b83008b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432759.100421:0:11725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5a4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11725:1874258812798336:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787432759.101572:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432759.102275:0:5879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791798656 00000100:00100000:1.0:1787432759.102286:0:5879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791798656 00000100:00100000:1.0:1787432759.102359:0:5879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:1.0:1787432759.102371:0:5879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ee8b542c-0113-490f-a721-62606ee0807f+52:10487:x1874258791798656:12345-192.168.202.15@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787432759.102466:0:5879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ee8b542c-0113-490f-a721-62606ee0807f+52:10487:x1874258791798656:12345-192.168.202.15@tcp:900:lhsmtool_posix.0 Request processed in 97us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432759.102490:0:5879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00080000:0.0:1787432759.102544:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432759.133361:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432759.133439:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791798784 00000100:00100000:3.0:1787432759.133450:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791798784 00000100:00100000:3.0:1787432759.133509:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 68 00000100:00100000:3.0:1787432759.133520:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+52:10487:x1874258791798784:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787432759.133552:0:8110:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787432759.133680:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+52:10487:x1874258791798784:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 161us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432759.133688:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 68 00000100:00100000:0.0:1787432759.137604:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432759.137705:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791798912 00000100:00100000:2.0:1787432759.137714:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791798912 00000100:00100000:2.0:1787432759.137764:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:2.0:1787432759.137773:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+52:10487:x1874258791798912:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787432759.137846:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0ff81 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.137886:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0ff81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.137898:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0ff81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.137924:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0ff88 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.137932:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0ff88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.137940:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0ff88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.137969:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0ff8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.137978:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0ff8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.137984:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0ff8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432759.138030:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787432759.138035:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787432759.138048:0:5869:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0ff8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138058:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0ff81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138063:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0ff81 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138070:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0ff81 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138085:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432759.138089:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0ff81 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138095:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0ff81 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138108:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff935b8304a100) 00010000:00010000:2.0:1787432759.138115:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432759.138121:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0ff81 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138127:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f0ff81 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138138:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0ff88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138144:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0ff88 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138149:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0ff88 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138154:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432759.138157:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0ff88 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138162:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0ff88 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138179:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff935b952e8100) 00010000:00010000:2.0:1787432759.138181:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432759.138184:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0ff88 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138189:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f0ff88 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138203:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0ff8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138209:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0ff8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138214:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0ff8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138219:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432759.138222:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0ff8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138227:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0ff8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138233:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935ba2a69b00) 00010000:00010000:2.0:1787432759.138236:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432759.138239:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0ff8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.138243:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f0ff8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432759.138337:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+52:10487:x1874258791798912:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 Request processed in 563us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432759.138346:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:2.0:1787432759.144218:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432759.144280:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791799168 00000100:00100000:3.0:1787432759.144288:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791799168 00000100:00100000:3.0:1787432759.144336:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 70 00000100:00100000:3.0:1787432759.144343:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+52:10487:x1874258791799168:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432759.144362:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432759.144379:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0ff96 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025caf expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.144476:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.144489:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.144498:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432759.144507:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787432759.144584:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.144589:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.144594:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.144598:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432759.144601:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.144605:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.144614:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935ba2a69b00) 00010000:00010000:3.0:1787432759.144617:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432759.144620:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.144631:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ff9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.144700:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0ff96 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025caf expref: 54 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.144711:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff935b8304a100) 00010000:00010000:3.0:1787432759.144713:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432759.144717:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0ff96 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025caf expref: 54 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.144728:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154000, rc 0) 00000100:00100000:3.0:1787432759.144781:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+53:10487:x1874258791799168:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 438us (572us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1787432759.144787:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 70 00000100:00100000:1.0:1787432759.148836:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432759.149047:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791799296 00000100:00100000:0.0:1787432759.149057:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791799296 00000100:00100000:0.0:1787432759.149112:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 71 00000100:00100000:0.0:1787432759.149121:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+53:10487:x1874258791799296:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787432759.149159:0:6929:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787432759.149273:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+53:10487:x1874258791799296:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 153us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432759.149281:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 71 00000100:00100000:0.0:1787432759.157122:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432759.157266:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791799552 00000100:00100000:3.0:1787432759.157277:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791799552 00000100:00100000:3.0:1787432759.157345:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 72 00000100:00100000:3.0:1787432759.157355:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+53:10487:x1874258791799552:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432759.157378:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432759.157381:0:5867:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787432759.157405:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7400/0xbcb9e331c3f0ff57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ca1 expref: 53 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.157422:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:3.0:1787432759.157427:0:5867:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432759.157454:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0ffab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025cb6 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787432759.158268:0:5867:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787432759.158489:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ffb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.158505:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ffb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.158516:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ffb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.158575:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0ffab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cb6 expref: 55 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.158593:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ffb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cb6 expref: 54 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.158602:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff935b8304a200) 00010000:00010000:3.0:1787432759.158605:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432759.158608:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155600, rc 0) 00000100:00100000:3.0:1787432759.158783:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+54:10487:x1874258791799552:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 1428us (2132us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787432759.158800:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 72 00000100:00100000:1.0:1787432759.171938:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432759.172111:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791799808 00000100:00100000:0.0:1787432759.172123:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791799808 00000100:00100000:0.0:1787432759.172188:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 73 00000100:00100000:0.0:1787432759.172198:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+54:10487:x1874258791799808:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787432759.172260:0:5868:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432759.172287:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f0ffb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cb6 expref: 54 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.172309:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff935b8304a200) 00010000:00010000:0.0:1787432759.172327:0:5868:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787432759.172349:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f0ffc0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.172363:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f0ffc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.172373:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f0ffc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.172429:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f0ffc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7074910 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.172437:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f0ffc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7074910 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.172444:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f0ffc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7074910 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.172520:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f0ffc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.172528:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f0ffc0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.172534:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f0ffc0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.172541:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cea00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432759.172545:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f0ffc0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.172552:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f0ffc0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.172567:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:0.0:1787432759.172570:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432759.172574:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f0ffc0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.172581:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f0ffc0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.172591:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f0ffc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7074910 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.172597:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f0ffc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7074910 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.172602:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f0ffc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7074910 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.172608:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cee00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432759.172610:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f0ffc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7074910 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.172615:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f0ffc7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7074910 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.172623:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7074910 (ffff935b9838f800) 00010000:00010000:0.0:1787432759.172625:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432759.172628:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f0ffc7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7074910 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.172634:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f0ffc7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7074910 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432759.172755:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+53:10487:x1874258791799808:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 557us (827us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787432759.172763:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 73 00000100:00100000:1.0:1787432759.187986:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432759.188090:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791799936 00000100:00100000:3.0:1787432759.188101:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791799936 00000100:00100000:3.0:1787432759.188200:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 74 00000100:00100000:3.0:1787432759.188211:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+53:10487:x1874258791799936:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432759.188245:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432759.188271:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0ffce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025cbd expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.188311:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ffd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.188324:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ffd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.188336:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ffd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.188432:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0ffce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cbd expref: 55 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.188448:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ffd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cbd expref: 54 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.188456:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff935b8304a700) 00010000:00010000:3.0:1787432759.188459:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787432759.188462:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154800, rc 0) 00000100:00100000:3.0:1787432759.188528:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+54:10487:x1874258791799936:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 319us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432759.188535:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 74 00000100:00100000:3.0:1787432759.202981:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432759.203788:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791800192 00000100:00100000:3.0:1787432759.203799:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791800192 00000100:00100000:3.0:1787432759.203856:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 75 00000100:00100000:3.0:1787432759.203886:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+54:10487:x1874258791800192:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787432759.203985:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f0ffdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.204854:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f0ffdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.204882:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f0ffdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787432759.208513:0:5867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1787432759.208531:0:5867:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 393873873339ns, next at 394873870055ns, rc = 0 00000004:00010000:3.0:1787432759.208643:0:5867:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a26b09a5 reply state 0000000015aa7b88 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f0ffdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432759.209085:0:5867:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787432759.209236:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+56:10487:x1874258791800192:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 5360us (6262us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1787432759.209246:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 75 00000100:00100000:3.0:1787432759.214396:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:3.0:1787432759.214428:0:3317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f0ffdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.214441:0:3317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f0ffdc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.214448:0:3317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f0ffdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.214454:0:3317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432759.214468:0:3317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f0ffdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.214477:0:3317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f0ffdc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.214494:0:3317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff935b8304a700) 00010000:00010000:3.0:1787432759.214497:0:3317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787432759.214549:0:3317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f0ffdc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.214557:0:3317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f0ffdc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432759.215067:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791800320 00000100:00100000:1.0:1787432759.215077:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791800320 00000100:00100000:1.0:1787432759.215130:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:1.0:1787432759.215141:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+55:10487:x1874258791800320:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787432759.215165:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432759.215183:0:6929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f0ffe3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025cc4 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.215244:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f0ffe3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cc4 expref: 56 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.215257:0:6929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f0ffe3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cc4 expref: 56 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.215276:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff935b8304a700) 00010000:00010000:1.0:1787432759.215279:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787432759.215282:0:6929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e7200, rc 0) 00000100:00100000:1.0:1787432759.215340:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+56:10487:x1874258791800320:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 201us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432759.215348:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:0.0:1787432759.222219:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432759.222807:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791800448 00000100:00100000:3.0:1787432759.222818:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791800448 00000100:00100000:3.0:1787432759.222869:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:3.0:1787432759.222895:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2374:x1874258791800448:12345-192.168.202.15@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787432759.222927:0:6725:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp t0 exp 0000000000000000 cur 393 last 0 00000020:00000080:3.0:1787432759.222961:0:6725:0:(genops.c:1385:class_connect()) connect: client ee8b542c-0113-490f-a721-62606ee0807f, cookie 0xbcb9e331c3f0ffea 00002000:00100000:3.0:1787432759.222973:0:6725:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ee8b542c-0113-490f-a721-62606ee0807f/ffff935bbb06d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787432759.223072:0:6725:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787432759.223311:0:6725:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787432759.223345:0:6725:0:(import.c:65:import_set_state_nolock()) ffff935bbb06b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787432759.223420:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2374:x1874258791800448:12345-192.168.202.15@tcp:8:lhsmtool_posix.0 Request processed in 530us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432759.223428:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:3.0:1787432759.227321:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432759.227715:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791800576 00000100:00100000:0.0:1787432759.227726:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791800576 00000100:00100000:0.0:1787432759.227922:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:0.0:1787432759.227933:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8b542c-0113-490f-a721-62606ee0807f+6:0:x1874258791800576:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787432759.228688:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432759.280471:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8b542c-0113-490f-a721-62606ee0807f+7:0:x1874258791800576:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 52528us (53150us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787432759.280486:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 25 00000001:00080000:1.0:1787432759.281177:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:1.0:1787432759.281196:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ee8b542c-0113-490f-a721-62606ee0807f 00000100:00100000:3.0:1787432759.293259:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432759.294441:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791800832 00000100:00100000:2.0:1787432759.294454:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791800832 00000100:00100000:3.0:1787432759.294625:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:3.0:1787432759.294635:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+56:10487:x1874258791800832:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787432759.294948:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+57:10487:x1874258791800832:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 312us (1699us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787432759.294955:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:0.0:1787432759.311198:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432759.311292:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791801088 00000100:00100000:3.0:1787432759.311302:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791801088 00000100:00100000:3.0:1787432759.311371:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00100000:3.0:1787432759.311382:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+57:10487:x1874258791801088:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787432759.311549:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+57:10487:x1874258791801088:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 169us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432759.311557:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00100000:1.0:1787432759.314637:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432759.315213:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791801216 00000100:00100000:3.0:1787432759.315225:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791801216 00000100:00100000:3.0:1787432759.315329:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 78 00000100:00100000:3.0:1787432759.315341:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+57:10487:x1874258791801216:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432759.315363:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432759.315385:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f0fff1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025ccb expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.315458:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0fff8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.315473:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0fff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.315497:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0fff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432759.315537:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432759.315557:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0fff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.315585:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f0fff1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ccb expref: 59 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.315605:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0fff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ccb expref: 58 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.315615:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff935b8304a700) 00010000:00010000:3.0:1787432759.315617:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787432759.315622:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154000, rc 0) 00000100:00100000:3.0:1787432759.315767:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+58:10487:x1874258791801216:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 427us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432759.315775:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 78 00000100:00100000:2.0:1787432759.328989:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432759.329318:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791801344 00000100:00100000:3.0:1787432759.329329:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791801344 00000100:00100000:3.0:1787432759.329393:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:3.0:1787432759.329404:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+5:2377:x1874258791801344:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432759.329422:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432759.329447:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f0ffff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025cd2 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432759.329495:0:6725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a0f37, blocks: 0x1 00010000:00010000:3.0:1787432759.329515:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1787432759.329520:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432759.329530:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f0ffff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cd2 expref: 6 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.329551:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f0ffff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cd2 expref: 6 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.329565:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154600, rc 0) 00000100:00100000:3.0:1787432759.329774:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2377:x1874258791801344:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 371us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432759.329782:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:2.0:1787432759.334617:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432759.334742:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791801600 00000100:00100000:1.0:1787432759.334753:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791801600 00000100:00100000:1.0:1787432759.334825:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 79 00000100:00100000:1.0:1787432759.334836:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+58:10487:x1874258791801600:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787432759.334973:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+58:10487:x1874258791801600:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 137us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432759.334981:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 79 00000100:00100000:2.0:1787432759.338032:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432759.338185:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791801728 00000100:00100000:0.0:1787432759.338194:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791801728 00000100:00100000:0.0:1787432759.338291:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:0.0:1787432759.338303:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:10487:x1874258791801728:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432759.338321:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432759.338343:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a28f132f/0xbcb9e331c3f10006 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025cd9 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.338374:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f0ffff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cd2 expref: 7 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.338383:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787432759.338387:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432759.338407:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a28f132f/0xbcb9e331c3f10006 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cd9 expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.338440:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f0ffff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cd2 expref: 7 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.338453:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f0ffff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cd2 expref: 7 pid: 6725 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432759.338465:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8446:1874258812798464:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787432759.338555:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91679480 going to sleep for 11 seconds 00000100:00100000:2.0:1787432759.342538:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432759.342617:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791801856 00000100:00100000:3.0:1787432759.342630:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791801856 00010000:00010000:3.0:1787432759.342700:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f0ffff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cd2 expref: 8 pid: 6725 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432759.342742:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:3.0:1787432759.342753:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935ba07d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+8:2376:x1874258791801856:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432759.342771:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432759.342810:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f0ffff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cd2 expref: 8 pid: 6725 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.342848:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f0ffff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cd2 expref: 8 pid: 6725 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.342897:0:5852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432759.342902:0:5852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432759.342910:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a28f132f/0xbcb9e331c3f10006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cd9 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.342921:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a28f132f/0xbcb9e331c3f10006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cd9 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.342965:0:5852:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a28f132f/0xbcb9e331c3f10006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cd9 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432759.342981:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba866300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5852:1874258812798592:192.168.202.15@tcp:105: 00000100:00100000:3.0:1787432759.343084:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b98bf4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432759.346418:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba866300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5852:1874258812798592:192.168.202.15@tcp:105: 00010000:00010000:3.0:1787432759.346449:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432759.346511:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935ba07d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+8:2376:x1874258791801856:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 3759us (3986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432759.346523:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 42 00010000:00010000:0.0:1787432759.348124:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f0ffff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cd2 expref: 7 pid: 6725 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432759.348151:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8446:1874258812798464:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787432759.348180:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a28f132f/0xbcb9e331c3f10006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025cd9 expref: 6 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.348196:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1ce800, rc 0) 00000100:00100000:0.0:1787432759.348258:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:10487:x1874258791801728:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 9957us (10387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432759.348267:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:1.0:1787432759.355704:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432759.355809:0:6731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791801984 00000100:00100000:2.0:1787432759.355820:0:6731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791801984 00002000:00100000:2.0:1787432759.355885:0:6731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff935bbb5a7b80 x1874258791801984/t0(0) o4->ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp:470/0 lens 504/0 e 0 to 0 dl 1787432770 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787432759.355897:0:6731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935bbb5a7b80 with x1874258791801984 ext(0->8) 00002000:00010000:2.0:1787432759.355903:0:6731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff935bbb5a7b80 00000100:00100000:2.0:1787432759.355941:0:6731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:2.0:1787432759.355951:0:6731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791801984:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787432759.356626:0:6731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ee8b542c-0113-490f-a721-62606ee0807f+8:2375:x1874258791801984:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 Request processed in 674us (929us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787432759.356636:0:6731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00002000:00100000:2.0:1787432759.356643:0:6731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff935bbb5a7b80 x1874258791801984/t4294967302(0) o4->ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp:470/0 lens 504/448 e 0 to 0 dl 1787432770 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787432759.356652:0:6731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935bbb5a7b80 with x1874258791801984 ext(0->8) 00002000:00010000:2.0:1787432759.357096:0:6731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff935bbb5a7b80 00000100:00100000:1.0:1787432759.360785:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432759.360974:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791802112 00000100:00100000:0.0:1787432759.360983:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791802112 00000100:00100000:0.0:1787432759.361068:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 80 00000100:00100000:0.0:1787432759.361079:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+58:10487:x1874258791802112:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787432759.391357:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:1.0:1787432759.391431:0:5889:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787432759.391456:0:5889:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff935b8687cf00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787432759.391461:0:5889:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff935b98ab5400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff935b8687c9c0 00000020:00080000:1.0:1787432759.391464:0:5889:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff935b98ab5700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff935bbfece000 00000001:00080000:1.0:1787432759.391481:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1787432759.391485:0:5889:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787432759.391691:0:5900:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787432759.392030:0:5900:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787432759.392112:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812798848:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787432759.392183:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432759.392240:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812798848 00000100:00100000:2.0:1787432759.392247:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812798848 00000100:00100000:2.0:1787432759.392308:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787432759.392318:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812798848:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787432759.392461:0:6725:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787432759.392465:0:6725:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787432759 00002000:00010000:2.0:1787432759.392468:0:6725:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787432759.392470:0:6725:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787432759 -> 1787432759 00002000:00010000:2.0:1787432759.392473:0:6725:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787432759.392515:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3332:x1874258812798848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 197us (330us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787432759.392522:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787432759.392545:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787432759.392575:0:3332:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff935bba888380/2, rc 0, transno 4294967303 00000100:00100000:2.0:1787432759.392581:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812798848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787432759.392685:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812798720:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787432759.392715:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432759.393012:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812798720 00000100:00100000:2.0:1787432759.393017:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812798720 00000100:00100000:2.0:1787432759.393098:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787432759.393106:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3331:x1874258812798720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787432759.393124:0:6724:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1787432759.393155:0:6724:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8a0f33, atime: 0x6a8a0f34, ctime: 0x6a8a0f33, blocks: 0x1 00010000:00010000:2.0:1787432759.393163:0:6724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f1000d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.393193:0:6724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1787432759.393198:0:6724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432759.393206:0:6724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f1000d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.393224:0:6724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f1000d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.393233:0:6724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f1000d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.393241:0:6724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f1000d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.393258:0:6724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787432759.393778:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3331:x1874258812798720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 671us (1060us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787432759.393785:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787432759.393984:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+13:10487:x1874258791802112:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 Request processed in 32904us (33203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432759.393994:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 80 00010000:00010000:2.0:1787432759.394409:0:5855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432759.394417:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f1000d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.394428:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f800 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432759.394433:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f1000d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.394455:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f1000d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.394474:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f1000d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.394483:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f1000d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.394506:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432759.394508:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432759.394510:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787432759.394549:0:3331:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff935bba889c00/2, rc 0, transno 4294967301 00000100:00100000:2.0:1787432759.394557:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812798720:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1787432759.398096:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787432759.399489:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432759.399602:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791802240 00000100:00100000:0.0:1787432759.399614:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791802240 00000100:00100000:0.0:1787432759.399810:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:0.0:1787432759.399822:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+8:2376:x1874258791802240:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1787432759.414076:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787432759.453779:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1787432759.453804:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1787432759.453990:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2376:x1874258791802240:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 Request processed in 54163us (54501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432759.454002:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:2.0:1787432759.458991:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432759.459154:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791802496 00000100:00100000:3.0:1787432759.459165:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791802496 00000100:00100000:3.0:1787432759.459231:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:3.0:1787432759.459243:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+13:10487:x1874258791802496:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787432759.459305:0:5868:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432759.459338:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f0fff8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ccb expref: 13 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.459359:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff935b8304a700) 00010000:00010000:3.0:1787432759.459365:0:5868:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432759.459397:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10014 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.459411:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.459421:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432759.459770:0:5868:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ffc13cc reply state 00000000257ffbb5 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432759.459779:0:5868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787432759.459895:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+14:10487:x1874258791802496:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 654us (913us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787432759.459903:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 81 00010000:00010000:2.0:1787432759.464237:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.464258:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10014 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.464266:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10014 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.464273:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432759.464279:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10014 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.464303:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10014 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.464321:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff935b8304a700) 00010000:00010000:2.0:1787432759.464325:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432759.464330:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10014 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.464337:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10014 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432759.467212:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432759.467405:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791802624 00000100:00100000:0.0:1787432759.467416:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791802624 00000100:00100000:0.0:1787432759.467481:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:0.0:1787432759.467492:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+6:2376:x1874258791802624:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787432759.467804:0:6726:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787432759.467809:0:6726:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787432759 -> 1787432757 00002000:00010000:0.0:1787432759.467812:0:6726:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787432756 00002000:00010000:0.0:1787432759.467814:0:6726:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787432759 -> 1787432757 00002000:00010000:0.0:1787432759.467816:0:6726:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787432759.468150:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+7:2376:x1874258791802624:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 657us (947us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787432759.468160:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:3.0:1787432759.476025:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432759.476470:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791802880 00000100:00100000:1.0:1787432759.476483:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791802880 00000100:00100000:1.0:1787432759.476558:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 82 00000100:00100000:1.0:1787432759.476577:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+13:10487:x1874258791802880:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787432759.476654:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f1001b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.476714:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ffd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cbd expref: 13 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.476723:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f1001b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.476761:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ffd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cbd expref: 13 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.476776:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ffd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cbd expref: 13 pid: 5869 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432759.476802:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5869:1874258812798976:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787432759.477288:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb9563e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432759.481829:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5869:1874258812798976:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787432759.481882:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f1001b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432759.483378:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432759.483580:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791803008 00000100:00100000:2.0:1787432759.483589:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791803008 00010000:00010000:2.0:1787432759.483626:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ffd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cbd expref: 14 pid: 5869 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432759.483712:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:2.0:1787432759.483722:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+14:2376:x1874258791803008:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432759.483738:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432759.483746:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ffd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cbd expref: 14 pid: 5869 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.483760:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ffd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cbd expref: 14 pid: 5869 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.483781:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f0ffd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cbd expref: 14 pid: 5869 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.483826:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff935b8304a700) 00010000:00010000:2.0:1787432759.483830:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f1001b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.483840:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f1001b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.483847:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f1001b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.483883:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432759.483930:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+13:2376:x1874258791803008:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 210us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432759.483937:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 43 00010000:00010000:3.0:1787432759.484553:0:5869:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f1001b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.484563:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f1001b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.484595:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f1001b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.484602:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f1001b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.484608:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f1001b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.484614:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6e00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432759.484618:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f1001b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.484625:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f1001b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.484636:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff935b8304a700) 00010000:00010000:3.0:1787432759.484639:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787432759.484642:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f1001b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.484648:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f1001b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432759.484737:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+12:10487:x1874258791802880:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 Request processed in 8161us (8723us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787432759.484762:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 82 00000100:00100000:3.0:1787432759.490546:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432759.490627:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791803136 00000100:00100000:2.0:1787432759.490637:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791803136 00000100:00100000:2.0:1787432759.490757:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00100000:2.0:1787432759.490767:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8b542c-0113-490f-a721-62606ee0807f+7:2377:x1874258791803136:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787432759.490821:0:6724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2e03839/0xbcb9e331c3f10022 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.490841:0:6724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a28f132f/0xbcb9e331c3f10006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025cd9 expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.490850:0:6724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432759.490863:0:6724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432759.490868:0:6724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e03839/0xbcb9e331c3f10022 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.490934:0:6724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a28f132f/0xbcb9e331c3f10006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x93816182a025cd9 expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.490948:0:6724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a28f132f/0xbcb9e331c3f10006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025cd9 expref: 7 pid: 8446 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432759.490963:0:6724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba888000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6724:1874258812799104:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432759.491036:0:6724:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2900 going to sleep for 11 seconds 00000100:00100000:0.0:1787432759.495908:0:6724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba888000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6724:1874258812799104:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787432759.495945:0:6724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2e03839/0xbcb9e331c3f10022 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432759.502094:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432759.502207:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791803264 00000100:00100000:2.0:1787432759.502217:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791803264 00010000:00010000:2.0:1787432759.502335:0:8489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a28f132f/0xbcb9e331c3f10006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025cd9 expref: 8 pid: 8446 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432759.502391:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:2.0:1787432759.502401:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9556d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+8:2375:x1874258791803264:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432759.502416:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432759.502438:0:8489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a28f132f/0xbcb9e331c3f10006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025cd9 expref: 8 pid: 8446 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.502453:0:8489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a28f132f/0xbcb9e331c3f10006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025cd9 expref: 8 pid: 8446 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.502477:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a28f132f/0xbcb9e331c3f10006 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025cd9 expref: 8 pid: 8446 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.502516:0:8489:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432759.502520:0:8489:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432759.502529:0:8489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2e03839/0xbcb9e331c3f10022 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.502540:0:8489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e03839/0xbcb9e331c3f10022 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.502738:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432759.502800:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9556d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+7:2375:x1874258791803264:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 400us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432759.502819:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 44 00010000:00010000:0.0:1787432759.504111:0:6724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2e03839/0xbcb9e331c3f10022 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.504127:0:6724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2e03839/0xbcb9e331c3f10022 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.504451:0:6724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2e03839/0xbcb9e331c3f10022 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.504463:0:6724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2e03839/0xbcb9e331c3f10022 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.504484:0:6724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2e03839/0xbcb9e331c3f10022 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.504492:0:6724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e600 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432759.504497:0:6724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e03839/0xbcb9e331c3f10022 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.504506:0:6724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2e03839/0xbcb9e331c3f10022 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.504525:0:6724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2e03839/0xbcb9e331c3f10022 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.504532:0:6724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2e03839/0xbcb9e331c3f10022 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432759.504693:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8b542c-0113-490f-a721-62606ee0807f+6:2377:x1874258791803136:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 Request processed in 13922us (14154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432759.504703:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00100000:3.0:1787432759.516265:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432759.522626:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791803520 00000100:00100000:0.0:1787432759.522643:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791803520 00000100:00100000:1.0:1787432759.523435:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 83 00000100:00100000:1.0:1787432759.523448:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+12:10487:x1874258791803520:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787432759.523534:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f10029 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.523551:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f10029 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.523578:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f10029 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.525451:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f10030 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.525476:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f0ffe3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cc4 expref: 13 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.525485:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f10030 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.525526:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f0ffe3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cc4 expref: 13 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.525544:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f0ffe3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cc4 expref: 13 pid: 6929 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432759.525559:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5867:1874258812799232:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787432759.525649:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb9563e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432759.529987:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5867:1874258812799232:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787432759.530016:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f10030 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432759.532707:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432759.533153:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791803648 00000100:00100000:2.0:1787432759.533167:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791803648 00010000:00010000:2.0:1787432759.533216:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f0ffe3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cc4 expref: 14 pid: 6929 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432759.533270:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:2.0:1787432759.533279:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9555880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+14:2375:x1874258791803648:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432759.533294:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432759.533302:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f0ffe3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cc4 expref: 14 pid: 6929 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.533317:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f0ffe3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cc4 expref: 14 pid: 6929 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.533363:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f0ffe3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cc4 expref: 14 pid: 6929 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.533382:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff935b8304a700) 00010000:00010000:2.0:1787432759.533389:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f10030 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.533401:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f10030 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.533410:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f10030 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.533442:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432759.533494:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9555880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+13:2375:x1874258791803648:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 216us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432759.533503:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 45 00010000:00010000:3.0:1787432759.534429:0:5867:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f10030 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.534441:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f10030 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787432759.534651:0:5867:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1787432759.534865:0:5867:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1787432759.534931:0:5867:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1787432759.535026:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9554e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5867:1874258812799360:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787432759.535090:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432759.535117:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b909a1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432759.535764:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812799360 00000100:00100000:0.0:1787432759.535774:0:5873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812799360 00000100:00100000:0.0:1787432759.535846:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432759.535858:0:5873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5867:x1874258812799360:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787432759.535961:0:5873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5867:x1874258812799360:12345-0@lo:1000:mdt00_000.0 Request processed in 105us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432759.535969:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787432759.536372:0:5867:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787432759.536378:0:5867:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff935bba888380, transno 4294967303 00000100:00100000:3.0:1787432759.536400:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9554e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5867:1874258812799360:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787432759.537562:0:5867:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1787432759.537640:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9554e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5867:1874258812799488:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787432759.537727:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432759.537753:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b909a19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432759.538106:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812799488 00000100:00100000:0.0:1787432759.538113:0:5873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812799488 00000100:00100000:0.0:1787432759.538176:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432759.538186:0:5873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5867:x1874258812799488:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787432759.538402:0:5873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5867:x1874258812799488:12345-0@lo:1000:mdt00_000.0 Request processed in 217us (674us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787432759.538409:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432759.538830:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9554e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5867:1874258812799488:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787432759.538869:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f10030 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.538907:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f10030 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.538915:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f10030 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.538921:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6a00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432759.538926:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f10030 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.538934:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f10030 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.538949:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff935b8304a700) 00010000:00010000:3.0:1787432759.538952:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787432759.538957:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f10030 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.538962:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f10030 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.539005:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f0ff5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.539011:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f0ff5e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.539016:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f0ff5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.539020:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432759.539030:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f0ff5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.539036:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f0ff5e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.539044:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935ba2a69b00) 00010000:00010000:3.0:1787432759.539046:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787432759.539049:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f0ff5e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.539055:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f0ff5e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.539098:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10037 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.539114:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f0ff7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ca8 expref: 16 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.539123:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10037 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.539439:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f0ff7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ca8 expref: 16 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432759.539454:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f0ff7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ca8 expref: 16 pid: 5868 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432759.539469:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9554700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5867:1874258812799616:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787432759.539548:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b909a1480 going to sleep for 11 seconds 00000100:00100000:2.0:1787432759.542713:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812799744:0@lo:400:kworker.0 00000100:00100000:0.0:1787432759.542719:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874258812799872:0@lo:400:kworker.0 00000100:00100000:3.0:1787432759.542848:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba45c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812800128:0@lo:400:kworker.0 00000100:00100000:0.0:1787432759.555962:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432759.556027:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432759.556040:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b86830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812800000:0@lo:400:kworker.0 00000100:00100000:0.0:1787432759.556098:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432759.556231:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432759.558620:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812799872 00000100:00100000:2.0:1787432759.558636:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812799872 00000100:00100000:2.0:1787432759.558712:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812800000 00000100:00100000:2.0:1787432759.558716:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812800000 00000100:00100000:2.0:1787432759.558759:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787432759.558770:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874258812799872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432759.561996:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787432759.562026:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812800000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432759.562129:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812800000:12345-0@lo:400:kworker.0 Request processed in 118us (6029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432759.562150:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787432759.562226:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b86830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812800000:0@lo:400:kworker.0 00000100:00100000:2.0:1787432759.562420:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874258812799872:12345-0@lo:400:kworker.0 Request processed in 3651us (7613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432759.562429:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787432759.562483:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432759.562585:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874258812799872:0@lo:400:kworker.0 00000100:00100000:1.0:1787432759.562684:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9554700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5867:1874258812799616:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787432759.562707:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10037 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787432759.562751:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432759.562922:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791803776 00000100:00100000:2.0:1787432759.562930:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791803776 00010000:00010000:2.0:1787432759.562960:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f0ff7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ca8 expref: 17 pid: 5868 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432759.562997:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:2.0:1787432759.563006:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+17:2375:x1874258791803776:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432759.563018:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432759.563025:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f0ff7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ca8 expref: 17 pid: 5868 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.563037:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f0ff7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ca8 expref: 17 pid: 5868 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.563059:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f0ff7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ca8 expref: 17 pid: 5868 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.563078:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935ba2a69b00) 00010000:00010000:2.0:1787432759.563082:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10037 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.563092:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10037 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.563100:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10037 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.563131:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432759.563176:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+16:2375:x1874258791803776:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 171us (6946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432759.563191:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 46 00010000:00010000:1.0:1787432759.564342:0:5867:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10037 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.564354:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10037 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.564368:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10037 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.564375:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10037 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.564382:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10037 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.564387:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432759.564392:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10037 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.564399:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10037 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.564414:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935ba2a69b00) 00010000:00010000:1.0:1787432759.564417:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432759.564421:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10037 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.564427:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10037 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.564461:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f10029 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.564467:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f10029 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.564473:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f10029 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.564478:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e7c00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432759.564480:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f10029 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.564485:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f10029 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.564493:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935ba2a69b00) 00010000:00010000:1.0:1787432759.564495:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787432759.564498:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f10029 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432759.564503:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f10029 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787432759.565585:0:11725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787432759.565592:0:11725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787432759.565619:0:11725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787432759.565625:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787432759.565738:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+15:10487:x1874258791803520:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 42287us (49602us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1787432759.565762:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 83 00000020:00080000:1.0:1787432759.565767:0:5867:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787432759.566211:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812799744 00000100:00100000:3.0:1787432759.566220:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812799744 00000100:00100000:2.0:1787432759.566982:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432759.567090:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812800128 00000100:00100000:1.0:1787432759.567095:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812800128 00000100:00100000:1.0:1787432759.567164:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787432759.567175:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812800128:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787432759.567555:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432759.568351:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812800128:12345-0@lo:400:kworker.0 Request processed in 62us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432759.568364:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787432759.568436:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba45c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812800128:0@lo:400:kworker.0 00000100:00100000:3.0:1787432759.568629:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787432759.568645:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3333:x1874258812799744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432759.568742:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3333:x1874258812799744:12345-0@lo:400:kworker.0 Request processed in 104us (6259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432759.568749:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787432759.569108:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812799744:0@lo:400:kworker.0 00000100:00100000:3.0:1787432759.579714:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432759.579894:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791804032 00000100:00100000:0.0:1787432759.579904:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791804032 00000100:00100000:0.0:1787432759.579967:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:0.0:1787432759.579978:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+15:10487:x1874258791804032:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787432759.580770:0:5871:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787432759.581652:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1787432759.582044:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f1003e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.582062:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f1003e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.582075:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f1003e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.582084:0:5871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f1003e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.582090:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f1003e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.582096:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f1003e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432759.582112:0:5871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787432759.582257:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+17:10487:x1874258791804032:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 2276us (2594us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1787432759.582275:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00000020:00080000:0.0:1787432759.582282:0:5871:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787432759.582368:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432759.582377:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f1003e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.582385:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cfc00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432759.582390:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f1003e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.582398:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f1003e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.582411:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff935b9838f100) 00010000:00010000:2.0:1787432759.582414:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787432759.582418:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f1003e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.582424:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f1003e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432759.582442:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432759.582444:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432759.582446:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432760.054591:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432760.054627:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812800256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432760.054741:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432760.056013:0:9985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812800256 00000100:00100000:2.0:1787432760.056026:0:9985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812800256 00000100:00100000:2.0:1787432760.056088:0:9985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787432760.056098:0:9985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3332:x1874258812800256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432760.056135:0:9985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787432760.056202:0:9985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3332:x1874258812800256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432760.056209:0:9985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787432760.056319:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812800256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432760.056649:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812800384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432760.056705:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432760.056859:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812800384 00000100:00100000:3.0:1787432760.056864:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812800384 00000100:00100000:3.0:1787432760.056919:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787432760.056927:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3330:x1874258812800384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432760.056954:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787432760.056995:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3330:x1874258812800384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432760.057001:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787432760.057043:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9554380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812800384:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787432760.438513:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787432761.046053:0:12094:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787432761.046064:0:12094:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787432761.046120:0:12094:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787432761.046127:0:12094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1787432761.171620:0:6749:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:0.0:1787432761.171641:0:6749:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:0.0:1787432761.171647:0:6749:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1787432761.267078:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432761.267138:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432761.267164:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432761.267188:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432761.267213:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432761.267243:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791804672 00000100:00100000:2.0:1787432761.267255:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791804672 00000100:00100000:2.0:1787432761.267316:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791804544 00000100:00100000:2.0:1787432761.267319:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791804544 00000100:00100000:2.0:1787432761.267350:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:2.0:1787432761.267360:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:2378:x1874258791804672:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787432761.267433:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:2378:x1874258791804672:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 74us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432761.267441:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:2.0:1787432761.267458:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00100000:2.0:1787432761.267464:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2378:x1874258791804544:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787432761.267489:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2378:x1874258791804544:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 25us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432761.267510:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00080000:2.0:1787432761.267717:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787432761.267721:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432761.267849:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791804288 00000100:00100000:3.0:1787432761.267854:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791804288 00000100:00100000:3.0:1787432761.267906:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791804800 00000100:00100000:3.0:1787432761.267909:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791804800 00000100:00100000:3.0:1787432761.267934:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 143 00000100:00100000:3.0:1787432761.267940:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2378:x1874258791804800:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432761.267981:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2378:x1874258791804800:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 41us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432761.267988:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 143 00000100:00100000:3.0:1787432761.268001:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00100000:3.0:1787432761.268008:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+17:10506:x1874258791804288:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432761.268022:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432761.268044:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10045 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025ce0 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.268360:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155000/0xbcb9e331c3f1004c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.268377:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155000/0xbcb9e331c3f1004c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.268389:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155000/0xbcb9e331c3f1004c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432761.268403:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787432761.268612:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10045 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ce0 expref: 20 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.268635:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155000/0xbcb9e331c3f1004c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ce0 expref: 19 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.268645:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:3.0:1787432761.268648:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787432761.268653:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155000, rc 0) 00000100:00100000:3.0:1787432761.268727:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+19:10506:x1874258791804288:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 719us (1664us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787432761.268734:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00080000:2.0:1787432761.269029:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432761.269644:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791804416 00000100:00100000:0.0:1787432761.269653:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791804416 00000100:00100000:0.0:1787432761.269738:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 290 00000100:00100000:0.0:1787432761.269749:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2378:x1874258791804416:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432761.269810:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2378:x1874258791804416:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 63us (2671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432761.269817:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 290 00000100:00100000:3.0:1787432761.279911:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432761.280009:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791804928 00000100:00100000:0.0:1787432761.280020:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791804928 00000100:00100000:0.0:1787432761.280083:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 85 00000100:00100000:0.0:1787432761.280094:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+19:10506:x1874258791804928:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:0.0:1787432761.280175:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f1005a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280193:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f1005a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280205:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f1005a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280236:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f10061 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280244:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f10061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280251:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f10061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280591:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10068 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280601:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280609:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787432761.280688:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280701:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f1005a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280708:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f1005a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280715:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f1005a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280721:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cfe00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432761.280726:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f1005a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280741:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f1005a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280754:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:0.0:1787432761.280758:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432761.280763:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f1005a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280768:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f1005a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280780:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f10061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280786:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f10061 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280791:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f10061 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280797:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cfc00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432761.280799:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f10061 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280805:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f10061 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280813:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff935b9838f000) 00010000:00010000:0.0:1787432761.280816:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432761.280819:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f10061 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280835:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f10061 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280850:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280869:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10068 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280875:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280880:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cf200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432761.280884:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280890:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10068 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280898:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b9838fb00) 00010000:00010000:0.0:1787432761.280900:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432761.280903:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10068 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.280908:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10068 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432761.280985:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+19:10506:x1874258791804928:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 890us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432761.280993:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 85 00000100:00100000:2.0:1787432761.366207:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432761.366339:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791805184 00000100:00100000:3.0:1787432761.366349:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791805184 00000100:00100000:3.0:1787432761.366419:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 86 00000100:00100000:3.0:1787432761.366431:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+19:10509:x1874258791805184:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432761.366452:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432761.366472:0:6929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f1006f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025ce7 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.366546:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f10076 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.366560:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f10076 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.366573:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f10076 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.366587:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f1007d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.366595:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f1007d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.366602:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f1007d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.367611:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10084 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.367632:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.367639:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432761.367651:0:6929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787432761.367920:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f10076 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.367929:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f10076 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.367936:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f10076 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.367941:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155c00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432761.367945:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f10076 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.367952:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f10076 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.367964:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:3.0:1787432761.367967:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432761.367971:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f10076 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.367977:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f10076 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.367989:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f1007d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.368002:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f1007d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.368007:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f1007d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.368012:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432761.368015:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f1007d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.368021:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f1007d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.368029:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff935b8304ac00) 00010000:00010000:3.0:1787432761.368032:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432761.368035:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f1007d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.368041:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f1007d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.368263:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f1006f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ce7 expref: 22 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.368279:0:6929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ce7 expref: 21 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.368287:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304a700) 00010000:00010000:3.0:1787432761.368289:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432761.368300:0:6929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154a00, rc 0) 00000100:00100000:3.0:1787432761.368370:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+21:10509:x1874258791805184:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1940us (2177us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787432761.368379:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 86 00000100:00100000:0.0:1787432761.381081:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432761.381142:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791805312 00000100:00100000:2.0:1787432761.381163:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791805312 00000100:00100000:2.0:1787432761.381239:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 87 00000100:00100000:2.0:1787432761.381251:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+21:10509:x1874258791805312:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:2.0:1787432761.381322:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10092 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.381340:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.381353:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.381384:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.381392:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10092 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.381399:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10092 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.381405:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432761.381409:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10092 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.381436:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10092 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.381449:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304a700) 00010000:00010000:2.0:1787432761.381452:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787432761.381457:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10092 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.381463:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10092 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432761.381552:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+21:10509:x1874258791805312:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 302us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432761.381561:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 87 00000100:00100000:2.0:1787432761.402652:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432761.402780:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791805568 00000100:00100000:1.0:1787432761.402791:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791805568 00000100:00100000:1.0:1787432761.402864:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:1.0:1787432761.402876:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b835a1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+21:10509:x1874258791805568:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787432761.403117:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b835a1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+22:10509:x1874258791805568:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 242us (474us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787432761.403124:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00010000:00010000:3.0:1787432761.462373:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432761.469795:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432761.480775:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791805824 00000100:00100000:1.0:1787432761.480792:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791805824 00000100:00100000:2.0:1787432761.484956:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 88 00000100:00100000:2.0:1787432761.484974:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+22:10029:x1874258791805824:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787432761.485000:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432761.485021:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10099 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025cee expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.485128:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f100a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.485144:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10084 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ce7 expref: 23 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.485167:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f100a0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.485223:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ce7 expref: 23 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.485237:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10084 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ce7 expref: 23 pid: 6929 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432761.485252:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba88bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5868:1874258812800512:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432761.485363:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432761.509433:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432761.509622:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba88bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5868:1874258812800512:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787432761.509730:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f100a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432761.509977:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791805952 00000100:00100000:1.0:1787432761.509986:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791805952 00010000:00010000:1.0:1787432761.510028:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10084 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ce7 expref: 24 pid: 6929 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432761.510082:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:1.0:1787432761.510094:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+24:2376:x1874258791805952:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432761.510112:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432761.510121:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10084 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ce7 expref: 24 pid: 6929 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.510134:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ce7 expref: 24 pid: 6929 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.510158:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10084 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ce7 expref: 24 pid: 6929 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.510175:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304a700) 00010000:00010000:1.0:1787432761.510180:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f100a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.510189:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f100a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.510274:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f100a0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.510400:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432761.510464:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+23:2376:x1874258791805952:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 372us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432761.510473:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 47 00010000:00010000:2.0:1787432761.516335:0:5868:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f100a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.516356:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f100a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432761.516385:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787432761.517288:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10099 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cee expref: 24 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.517316:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f100a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cee expref: 23 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.517325:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304a700) 00010000:00010000:2.0:1787432761.517329:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787432761.517351:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e000, rc 0) 00000100:00100000:2.0:1787432761.518139:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+23:10029:x1874258791805824:12345-192.168.202.15@tcp:101:bash.0 Request processed in 33164us (48348us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1787432761.518151:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 88 00000100:00100000:0.0:1787432761.523616:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432761.523828:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791806208 00000100:00100000:3.0:1787432761.523845:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791806208 00000100:00100000:3.0:1787432761.523918:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 89 00000100:00100000:3.0:1787432761.523930:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+23:10029:x1874258791806208:12345-192.168.202.15@tcp:36:bash.0 00010000:00010000:3.0:1787432761.524291:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f100ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.524307:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f100ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.524320:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f100ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787432761.524402:0:6929:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1787432761.524428:0:6929:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001221900c reply state 000000002e54b310 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f100ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432761.524438:0:6929:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787432761.524487:0:6929:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1787432761.524623:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+27:10029:x1874258791806208:12345-192.168.202.15@tcp:36:bash.0 Request processed in 694us (1016us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787432761.524631:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 89 00000020:00080000:3.0:1787432761.524637:0:6929:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787432761.528590:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432761.529043:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791806336 00000100:00100000:0.0:1787432761.529053:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791806336 00000100:00100000:0.0:1787432761.529118:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 90 00000100:00100000:0.0:1787432761.529131:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+27:10029:x1874258791806336:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787432761.529163:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432761.529190:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f100b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025cf5 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.529345:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f100b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cf5 expref: 28 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.529362:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f100b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cf5 expref: 28 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.529383:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304a700) 00010000:00010000:0.0:1787432761.529387:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787432761.529391:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cfe00, rc 0) 00000100:00100000:0.0:1787432761.529653:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+28:10029:x1874258791806336:12345-192.168.202.15@tcp:101:bash.0 Request processed in 524us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432761.529701:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 90 00010000:00010000:1.0:1787432761.530085:0:3317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f100ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.530107:0:3317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f100ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.530114:0:3317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f100ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.530120:0:3317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432761.530126:0:3317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f100ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.530134:0:3317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f100ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.530148:0:3317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304a700) 00010000:00010000:1.0:1787432761.530151:0:3317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432761.530156:0:3317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f100ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.530161:0:3317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f100ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432761.540783:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432761.547216:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791806464 00000100:00100000:2.0:1787432761.547235:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791806464 00000100:00100000:2.0:1787432761.547325:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:2.0:1787432761.547337:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:10029:x1874258791806464:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787432761.547358:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432761.547396:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a6d50f4/0xbcb9e331c3f100bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025cfc expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787432761.547726:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8a0f35, atime: 0x6a8a0f34, ctime: 0x6a8a0f35, blocks: 0xb 00010000:00010000:2.0:1787432761.547757:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787432761.547764:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432761.548177:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a6d50f4/0xbcb9e331c3f100bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cfc expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.548209:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a6d50f4/0xbcb9e331c3f100bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cfc expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.548224:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f400, rc 0) 00000100:00100000:0.0:1787432761.548456:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+7:10029:x1874258791806464:12345-192.168.202.15@tcp:101:bash.0 Request processed in 1119us (7687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432761.548472:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:3.0:1787432761.555341:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432761.556093:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791806592 00000100:00100000:0.0:1787432761.556106:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791806592 00002000:00010000:0.0:1787432761.556157:0:6729:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1787432761.556163:0:6729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935bba735180 with x1874258791806592 ext(0->18446744073709551615) 00002000:00010000:0.0:1787432761.556178:0:6729:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff935bba735180. 00000100:00100000:0.0:1787432761.556225:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:0.0:1787432761.556236:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba735180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ee8b542c-0113-490f-a721-62606ee0807f+7:2377:x1874258791806592:12345-192.168.202.15@tcp:10:bash.0 00002000:00010000:0.0:1787432761.556561:0:6729:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787432761.556565:0:6729:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787432757 -> 1787432761 00002000:00010000:0.0:1787432761.556568:0:6729:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787432756 -> 1787432756 00002000:00010000:0.0:1787432761.556570:0:6729:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787432757 -> 1787432761 00002000:00010000:0.0:1787432761.556572:0:6729:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787432761.556644:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba735180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ee8b542c-0113-490f-a721-62606ee0807f+8:2377:x1874258791806592:12345-192.168.202.15@tcp:10:bash.0 Request processed in 409us (1314us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787432761.556653:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 1 00002000:00010000:0.0:1787432761.557213:0:6729:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1787432761.557218:0:6729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935bba735180 with x1874258791806592 ext(0->18446744073709551615) 00002000:00010000:0.0:1787432761.557226:0:6729:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff935bba735180. 00000100:00100000:2.0:1787432761.680552:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432761.680998:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791806720 00000100:00100000:0.0:1787432761.681010:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791806720 00000100:00100000:0.0:1787432761.681078:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 91 00000100:00100000:0.0:1787432761.681092:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+27:10523:x1874258791806720:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:0.0:1787432761.681378:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f100c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.681410:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f100c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.681454:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f100c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.681473:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f100ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.681481:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f100ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.681488:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f100ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.682085:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f100d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.682097:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f100d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.682115:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f100d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787432761.682873:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f100d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.682889:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f100c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.682896:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f100c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.682904:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f100c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.682924:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1ce800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432761.682928:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f100c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.682935:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f100c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.682948:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:0.0:1787432761.682951:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432761.682957:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f100c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.682962:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f100c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.682975:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f100ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.682981:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f100ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.682987:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f100ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.682992:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cea00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432761.682995:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f100ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.683001:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f100ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.683018:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff935b9838f800) 00010000:00010000:0.0:1787432761.683021:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432761.683024:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f100ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.683033:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f100ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.683050:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f100d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.683056:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f100d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.683062:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f100d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.683068:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cee00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432761.683071:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f100d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.683077:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f100d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.683083:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304a700) 00010000:00010000:0.0:1787432761.683085:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432761.683088:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f100d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.683094:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f100d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432761.683436:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+27:10523:x1874258791806720:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 2343us (2891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432761.683446:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 91 00000100:00100000:1.0:1787432761.756382:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432761.756483:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791806976 00000100:00100000:2.0:1787432761.756495:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791806976 00000100:00100000:2.0:1787432761.756560:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 92 00000100:00100000:2.0:1787432761.756570:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+27:10526:x1874258791806976:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787432761.756605:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432761.756626:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f100d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d03 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.756753:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f100df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.756769:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f100df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.756781:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f100df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.756797:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f100e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.756805:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f100e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.756821:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f100e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.757257:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f100ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.757268:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f100ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.757275:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f100ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432761.757287:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787432761.757390:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f100df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.757398:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f100df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.757404:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f100df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.757410:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432761.757415:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f100df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.757422:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f100df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.757435:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:2.0:1787432761.757438:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432761.757442:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f100df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.757448:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f100df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.757459:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f100e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.757465:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f100e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.757470:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f100e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.757475:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fc00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432761.757485:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f100e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.757491:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f100e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.757499:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff935b952e8800) 00010000:00010000:2.0:1787432761.757501:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432761.757504:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f100e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.757509:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f100e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.757553:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f100d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d03 expref: 30 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.757566:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f100ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d03 expref: 29 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.757574:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304a700) 00010000:00010000:2.0:1787432761.757577:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787432761.757579:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e400, rc 0) 00000100:00100000:2.0:1787432761.757638:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+29:10526:x1874258791806976:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1070us (1266us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787432761.757646:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 92 00000100:00100000:3.0:1787432761.768267:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432761.770362:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791807104 00000100:00100000:0.0:1787432761.770378:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791807104 00000100:00100000:1.0:1787432761.770803:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 93 00000100:00100000:1.0:1787432761.771169:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+29:10526:x1874258791807104:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:1.0:1787432761.771255:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f100fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.771275:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f100a0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cee expref: 29 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.771306:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f100fb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.771345:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f100a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cee expref: 29 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.771359:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f100a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cee expref: 29 pid: 5868 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432761.771374:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5867:1874258812800640:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787432761.771483:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b92bc1180 going to sleep for 11 seconds 00000100:00100000:1.0:1787432761.774570:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5867:1874258812800640:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787432761.774601:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f100fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432761.776306:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432761.776514:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791807360 00000100:00100000:1.0:1787432761.776523:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791807360 00000100:00100000:1.0:1787432761.776588:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:1.0:1787432761.776600:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+30:5616:x1874258791807360:12345-192.168.202.15@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787432761.777434:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+31:5616:x1874258791807360:12345-192.168.202.15@tcp:35:ldlm_bl.0 Request processed in 832us (1133us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787432761.777445:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:0.0:1787432761.785327:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432761.789592:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791807488 00000100:00100000:2.0:1787432761.789609:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791807488 00010000:00010000:2.0:1787432761.789679:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f100a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cee expref: 31 pid: 5868 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432761.789739:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:2.0:1787432761.789762:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+31:2376:x1874258791807488:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432761.789781:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432761.789791:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f100a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cee expref: 31 pid: 5868 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.789805:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f100a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cee expref: 31 pid: 5868 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.789860:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f100a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025cee expref: 31 pid: 5868 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.789880:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304a700) 00010000:00010000:2.0:1787432761.789886:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f100fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.789897:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f100fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.789904:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f100fb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.789940:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432761.790005:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+30:2376:x1874258791807488:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 256us (4842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432761.790012:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 48 00010000:00010000:1.0:1787432761.790409:0:5867:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f100fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.790419:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f100fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.790461:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f100fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.790469:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f100fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.790476:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f100fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.790482:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432761.790487:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f100fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.790496:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f100fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.790507:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304a700) 00010000:00010000:1.0:1787432761.790510:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787432761.790514:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f100fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.790521:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f100fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432761.790586:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+29:10526:x1874258791807104:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 19773us (22328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432761.790594:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 93 00000100:00100000:0.0:1787432761.793492:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432761.793575:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791807744 00000100:00100000:2.0:1787432761.793597:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791807744 00000100:00100000:2.0:1787432761.793699:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:2.0:1787432761.793710:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+29:10526:x1874258791807744:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787432761.795269:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+30:10526:x1874258791807744:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 1549us (1776us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787432761.795282:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:2.0:1787432761.888295:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432761.888495:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791808000 00000100:00100000:0.0:1787432761.888509:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791808000 00000100:00100000:0.0:1787432761.889022:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 94 00000100:00100000:0.0:1787432761.889038:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+30:10537:x1874258791808000:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:0.0:1787432761.889073:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432761.889102:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10102 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d0a expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.889206:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f10109 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.889224:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f10109 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.889236:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f10109 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.889254:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f10110 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.889262:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f10110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.889298:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f10110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.889943:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10117 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.889958:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10117 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.889967:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10117 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432761.889982:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1787432761.890102:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f10109 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.890110:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f10109 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.890117:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f10109 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.890124:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1ce600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432761.890130:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f10109 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.890139:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f10109 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.890154:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:0.0:1787432761.890157:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432761.890172:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f10109 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.890179:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f10109 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.890195:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f10110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.890201:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f10110 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.890206:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f10110 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.890211:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cec00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432761.890214:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f10110 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.890220:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f10110 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.890229:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff935b9838f800) 00010000:00010000:0.0:1787432761.890231:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432761.890234:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f10110 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.890241:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f10110 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.890303:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10102 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d0a expref: 33 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.890335:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10117 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d0a expref: 32 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.890343:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304a700) 00010000:00010000:0.0:1787432761.890346:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432761.890348:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1ce400, rc 0) 00000100:00100000:0.0:1787432761.890462:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+32:10537:x1874258791808000:12345-192.168.202.15@tcp:101:cat.0 Request processed in 1427us (2181us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1787432761.890472:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 94 00000100:00100000:3.0:1787432761.896387:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432761.896450:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791808256 00000100:00100000:1.0:1787432761.896465:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791808256 00000100:00100000:1.0:1787432761.897039:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:1.0:1787432761.897072:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+32:10537:x1874258791808256:12345-192.168.202.15@tcp:35:cat.0 00000100:00100000:1.0:1787432761.897411:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+33:10537:x1874258791808256:12345-192.168.202.15@tcp:35:cat.0 Request processed in 341us (1037us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787432761.897421:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:1.0:1787432761.922342:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432761.922483:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791808512 00000100:00100000:0.0:1787432761.922496:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791808512 00000100:00100000:0.0:1787432761.922893:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 95 00000100:00100000:0.0:1787432761.922905:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+33:10538:x1874258791808512:12345-192.168.202.15@tcp:36:rm.0 00010000:00010000:0.0:1787432761.922993:0:8110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787432761.923030:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10117 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d0a expref: 33 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.923050:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f100ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d03 expref: 32 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.923059:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f100b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cf5 expref: 31 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.923067:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b8304a700) 00010000:00010000:0.0:1787432761.923076:0:8110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787432761.923119:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10125 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.923134:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10125 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.923142:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10125 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.923153:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f1012c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.923157:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f1012c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.923162:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f1012c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.923901:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f10133 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.923916:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f10133 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.923924:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f10133 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787432761.925025:0:8110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1787432761.925039:0:8110:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 396590381245ns, next at 397590377952ns, rc = 0 00010000:00010000:0.0:1787432761.925129:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1013a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.925146:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1013a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.925169:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1013a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.925180:0:8110:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1013a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.925188:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1013a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.925195:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1013a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.925224:0:8110:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787432761.925254:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f10133 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.925260:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f10133 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.925265:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f10133 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.925271:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1ce600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432761.925277:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f10133 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.925284:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f10133 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.925296:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b9838fb00) 00010000:00010000:0.0:1787432761.925299:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787432761.925311:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f10133 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.925318:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f10133 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.925344:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10125 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.925350:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10125 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.925356:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10125 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.925361:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cf000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432761.925364:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10125 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.925370:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10125 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.925379:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:0.0:1787432761.925381:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432761.925384:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10125 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.925390:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10125 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787432761.925401:0:8110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091b042bd reply state 00000000289e64ce transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f1012c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432761.925423:0:8110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787432761.925799:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432761.925809:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1013a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.925816:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cfa00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432761.925820:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1013a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.925827:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1013a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.925837:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff935b9838fb00) 00010000:00010000:2.0:1787432761.925840:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787432761.925843:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1013a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.925860:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1013a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.925882:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432761.925885:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432761.925887:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432761.926061:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+32:10538:x1874258791808512:12345-192.168.202.15@tcp:36:rm.0 Request processed in 3150us (3729us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1787432761.926072:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 95 00010000:00010000:2.0:1787432761.931151:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f1012c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.931196:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f1012c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.931205:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f1012c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.931211:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cec00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432761.931217:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f1012c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.931227:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f1012c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.931249:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff935b9838f800) 00010000:00010000:2.0:1787432761.931252:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432761.931258:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f1012c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.931265:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f1012c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432761.974382:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432761.974510:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791808768 00000100:00100000:2.0:1787432761.974524:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791808768 00000100:00100000:2.0:1787432761.974624:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 96 00000100:00100000:2.0:1787432761.974637:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+31:10544:x1874258791808768:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787432761.974707:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432761.974738:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10141 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d11 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.974959:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10148 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.974979:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10148 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.974993:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10148 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.975011:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1014f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.975018:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1014f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.975026:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1014f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787432761.975753:0:5867:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787432761.975984:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10156 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.975998:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.976008:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.976053:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10148 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.976072:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10148 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.976079:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10148 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.976085:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fc00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432761.976091:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10148 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.976100:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10148 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.976115:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:2.0:1787432761.976119:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432761.976125:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10148 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.976131:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10148 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432761.976148:0:5867:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e792efd5 reply state 00000000146c5d5a transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1014f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432761.976158:0:5867:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787432761.977312:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10141 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d11 expref: 34 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.977354:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10156 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d11 expref: 33 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.977390:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b952e8e00) 00010000:00010000:2.0:1787432761.977393:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432761.977398:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f600, rc 0) 00000100:00100000:2.0:1787432761.977533:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+34:10544:x1874258791808768:12345-192.168.202.15@tcp:101:bash.0 Request processed in 2890us (3160us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787432761.977545:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 96 00000100:00100000:0.0:1787432761.982234:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:1.0:1787432761.982444:0:3317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1014f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.982460:0:3317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1014f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.982469:0:3317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1014f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.982476:0:3317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432761.982483:0:3317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1014f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.982492:0:3317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1014f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.982513:0:3317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff935b952e8800) 00010000:00010000:1.0:1787432761.982516:0:3317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432761.982522:0:3317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1014f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432761.982540:0:3317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1014f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432761.983524:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791808896 00000100:00100000:3.0:1787432761.983552:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791808896 00000100:00100000:3.0:1787432761.983758:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:3.0:1787432761.983781:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791808896:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:3.0:1787432761.983808:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432761.983834:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd09371d/0xbcb9e331c3f10164 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d18 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432761.983889:0:6725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432761.983917:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1787432761.983923:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432761.983941:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd09371d/0xbcb9e331c3f10164 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d18 expref: 6 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.983965:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd09371d/0xbcb9e331c3f10164 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d18 expref: 6 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432761.983983:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154000, rc 0) 00000100:00100000:3.0:1787432761.984072:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791808896:12345-192.168.202.15@tcp:101:bash.0 Request processed in 293us (1853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432761.984080:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:3.0:1787432761.987515:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432761.988169:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791809024 00000100:00100000:0.0:1787432761.988185:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791809024 00000100:00100000:0.0:1787432761.988304:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:0.0:1787432761.988318:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba734000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:10544:x1874258791809024:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787432761.988343:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432761.988371:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f1016b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d1f expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.988421:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd09371d/0xbcb9e331c3f10164 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d18 expref: 7 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.988431:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432761.988436:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432761.988442:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f1016b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d1f expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.988485:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd09371d/0xbcb9e331c3f10164 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d18 expref: 7 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.988502:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd09371d/0xbcb9e331c3f10164 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d18 expref: 7 pid: 6725 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432761.988559:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb600e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8446:1874258812800768:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787432761.989305:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b830089c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432761.993184:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432761.993339:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb600e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8446:1874258812800768:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787432761.993387:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f1016b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025d1f expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432761.993416:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cf000, rc 0) 00000100:00100000:0.0:1787432761.993498:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba734000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+7:10544:x1874258791809024:12345-192.168.202.15@tcp:101:bash.0 Request processed in 5182us (5998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432761.993508:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:2.0:1787432761.994052:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791809152 00000100:00100000:2.0:1787432761.994061:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791809152 00010000:00010000:2.0:1787432761.994106:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd09371d/0xbcb9e331c3f10164 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d18 expref: 7 pid: 6725 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432761.994151:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:2.0:1787432761.994161:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935ba07d4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+7:2376:x1874258791809152:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432761.994179:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432761.994211:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd09371d/0xbcb9e331c3f10164 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d18 expref: 7 pid: 6725 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.994227:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd09371d/0xbcb9e331c3f10164 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d18 expref: 7 pid: 6725 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.994259:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd09371d/0xbcb9e331c3f10164 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d18 expref: 7 pid: 6725 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.994281:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432761.994303:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432761.994314:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f1016b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025d1f expref: 6 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.994325:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f1016b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025d1f expref: 6 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432761.994372:0:5853:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f1016b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025d1f expref: 6 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432761.994389:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5853:1874258812800896:192.168.202.15@tcp:105: 00000100:00100000:2.0:1787432761.994474:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2540 going to sleep for 11 seconds 00000100:00100000:2.0:1787432761.999242:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba88b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5853:1874258812800896:192.168.202.15@tcp:105: 00010000:00010000:2.0:1787432761.999284:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432761.999360:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935ba07d4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+6:2376:x1874258791809152:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 5198us (6189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432761.999374:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:0.0:1787432762.004939:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432762.005178:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791809408 00000100:00100000:1.0:1787432762.005191:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791809408 00000100:00100000:1.0:1787432762.005270:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:1.0:1787432762.005284:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+33:10544:x1874258791809408:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:1.0:1787432762.006251:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+34:10544:x1874258791809408:12345-192.168.202.15@tcp:35:bash.0 Request processed in 963us (1318us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1787432762.006264:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:3.0:1787432762.143998:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432762.144284:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791809536 00000100:00100000:0.0:1787432762.144300:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791809536 00000100:00100000:0.0:1787432762.144419:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 97 00000100:00100000:0.0:1787432762.144430:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+34:10560:x1874258791809536:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787432762.144463:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432762.144486:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10172 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d26 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.144577:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f10179 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.144595:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f10179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.144623:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f10179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432762.144804:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787432762.144808:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787432762.144830:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f10179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.144871:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10172 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d26 expref: 36 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.144894:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f10179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d26 expref: 35 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.144905:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:0.0:1787432762.144907:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787432762.144910:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1ce200, rc 0) 00000100:00100000:0.0:1787432762.144996:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+35:10560:x1874258791809536:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 567us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432762.145004:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 97 00000100:00100000:0.0:1787432762.149117:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432762.149280:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791809792 00000100:00100000:1.0:1787432762.149294:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791809792 00000100:00100000:1.0:1787432762.149386:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 98 00000100:00100000:1.0:1787432762.149397:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+35:10560:x1874258791809792:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787432762.149422:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432762.149446:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f10180 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d2d expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.149584:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f10187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.149603:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f10187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.149618:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f10187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432762.149631:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787432762.149837:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f10180 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d2d expref: 38 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.149887:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f10187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d2d expref: 37 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.149899:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b952e8e00) 00010000:00010000:1.0:1787432762.149902:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432762.149905:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e6400, rc 0) 00000100:00100000:1.0:1787432762.149991:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+37:10560:x1874258791809792:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 595us (886us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787432762.150000:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 98 00000100:00100000:2.0:1787432762.153151:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432762.153438:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791809920 00000100:00100000:3.0:1787432762.153450:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791809920 00000100:00100000:3.0:1787432762.153526:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:3.0:1787432762.153540:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+37:2377:x1874258791809920:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432762.153560:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432762.153593:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f10187 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d2d expref: 37 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.153616:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b952e8e00) 00010000:00010000:3.0:1787432762.153622:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432762.154274:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+36:2377:x1874258791809920:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 731us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432762.154284:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:0.0:1787432762.154915:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432762.155247:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791810176 00000100:00100000:2.0:1787432762.155258:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791810176 00000100:00100000:2.0:1787432762.155350:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 99 00000100:00100000:2.0:1787432762.155361:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+36:10560:x1874258791810176:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787432762.155391:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432762.155419:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10195 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d34 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.155566:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1019c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.155585:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1019c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.155598:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1019c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432762.155614:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787432762.155865:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10195 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d34 expref: 39 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.155892:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1019c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d34 expref: 38 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.155902:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b952e8e00) 00010000:00010000:2.0:1787432762.155905:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787432762.155910:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e200, rc 0) 00000100:00100000:2.0:1787432762.156032:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+38:10560:x1874258791810176:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 671us (1118us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787432762.156040:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 99 00000100:00100000:1.0:1787432762.161272:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432762.161395:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791810304 00000100:00100000:2.0:1787432762.161409:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791810304 00000100:00100000:2.0:1787432762.161522:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:2.0:1787432762.161535:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8b542c-0113-490f-a721-62606ee0807f+6:2376:x1874258791810304:12345-192.168.202.15@tcp:1:lfs.0 00010000:00010000:2.0:1787432762.161598:0:6724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f101aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.161641:0:6724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f1016b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025d1f expref: 6 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.161651:0:6724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432762.161685:0:6724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432762.161691:0:6724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f101aa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.161739:0:6724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f1016b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x93816182a025d1f expref: 6 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.161754:0:6724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f1016b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025d1f expref: 6 pid: 8446 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432762.161910:0:6724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba88b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6724:1874258812801024:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432762.162095:0:6724:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2480 going to sleep for 11 seconds 00000100:00100000:2.0:1787432762.165326:0:6724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba88b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6724:1874258812801024:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787432762.165374:0:6724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f101aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432762.167371:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432762.168155:0:6731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791810432 00000100:00100000:2.0:1787432762.168170:0:6731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791810432 00002000:00100000:2.0:1787432762.168246:0:6731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff935bbb5da680 x1874258791810432/t0(0) o4->ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp:473/0 lens 504/0 e 0 to 0 dl 1787432773 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787432762.168284:0:6731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935bbb5da680 with x1874258791810432 ext(0->8) 00010000:00010000:2.0:1787432762.168297:0:6731:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f1016b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025d1f expref: 7 pid: 8446 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.168333:0:6731:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f1016b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025d1f expref: 7 pid: 8446 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787432762.168342:0:6731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff935bbb5da680 00000100:00100000:2.0:1787432762.168385:0:6731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:2.0:1787432762.168397:0:6731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ee8b542c-0113-490f-a721-62606ee0807f+7:2375:x1874258791810432:12345-192.168.202.15@tcp:4:lfs.0 00000100:00100000:2.0:1787432762.170201:0:6731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ee8b542c-0113-490f-a721-62606ee0807f+9:2375:x1874258791810432:12345-192.168.202.15@tcp:4:lfs.0 Request processed in 1791us (2831us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787432762.170218:0:6731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 1 00002000:00100000:2.0:1787432762.171061:0:6731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff935bbb5da680 x1874258791810432/t4294967302(0) o4->ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp:473/0 lens 504/448 e 0 to 0 dl 1787432773 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787432762.171080:0:6731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935bbb5da680 with x1874258791810432 ext(0->8) 00010000:00010000:2.0:1787432762.171096:0:6731:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f1016b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025d1f expref: 9 pid: 8446 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.171116:0:6731:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f1016b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025d1f expref: 9 pid: 8446 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787432762.171124:0:6731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff935bbb5da680 00000100:00100000:0.0:1787432762.172858:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432762.173021:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791810560 00000100:00100000:1.0:1787432762.173034:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791810560 00010000:00010000:1.0:1787432762.173079:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f1016b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025d1f expref: 9 pid: 8446 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432762.173122:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:1.0:1787432762.173133:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb603b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+9:2378:x1874258791810560:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432762.173155:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787432762.173185:0:5851:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787432762.173188:0:5851:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787432762 00002000:00010000:1.0:1787432762.173191:0:5851:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787432762 00002000:00010000:1.0:1787432762.173193:0:5851:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787432762 00010000:00010000:1.0:1787432762.173200:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f1016b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025d1f expref: 9 pid: 8446 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.173238:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f1016b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025d1f expref: 9 pid: 8446 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.173265:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f1016b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025d1f expref: 9 pid: 8446 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.173282:0:5851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787432762.173287:0:5851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787432762.173292:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f101aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.173299:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f101aa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.173337:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432762.173486:0:6724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f101aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.173501:0:6724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f101aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.173528:0:6724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f101aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.173537:0:6724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f101aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.173546:0:6724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f101aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.173554:0:6724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f800 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432762.173560:0:6724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f101aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.173570:0:6724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f101aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.173584:0:6724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f101aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.173591:0:6724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f101aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432762.173822:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb603b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+8:2378:x1874258791810560:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 687us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432762.173838:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:2.0:1787432762.174008:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8b542c-0113-490f-a721-62606ee0807f+7:2376:x1874258791810304:12345-192.168.202.15@tcp:1:lfs.0 Request processed in 12475us (12751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432762.174016:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:1.0:1787432762.178419:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432762.180445:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791810816 00000100:00100000:2.0:1787432762.180466:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791810816 00000100:00100000:2.0:1787432762.180624:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:2.0:1787432762.180640:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8355c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+38:10560:x1874258791810816:12345-192.168.202.15@tcp:35:lfs.0 00000004:00010000:2.0:1787432762.180749:0:5871:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1019c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d34 expref: 38 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787432762.181124:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1787432762.181153:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1787432762.182006:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1787432762.182081:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f101b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.182100:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10156 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d11 expref: 42 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.182108:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f101b1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.182148:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10156 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d11 expref: 42 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.182161:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10156 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d11 expref: 42 pid: 5867 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432762.182188:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba88b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5871:1874258812801152:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432762.182300:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2480 going to sleep for 11 seconds 00000100:00100000:3.0:1787432762.187950:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432762.188103:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791810944 00000100:00100000:1.0:1787432762.188117:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791810944 00010000:00010000:1.0:1787432762.188175:0:8489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10156 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d11 expref: 43 pid: 5867 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432762.188241:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:1.0:1787432762.188252:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba735880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+43:2376:x1874258791810944:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432762.188293:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432762.188302:0:8489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10156 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d11 expref: 43 pid: 5867 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.188319:0:8489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10156 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d11 expref: 43 pid: 5867 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.188350:0:8489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b952e8e00) 00010000:00010000:1.0:1787432762.188356:0:8489:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f101b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.188367:0:8489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f101b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.188375:0:8489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f101b1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.188396:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432762.188402:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10156 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d11 expref: 43 pid: 5867 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432762.188421:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba88b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5871:1874258812801152:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787432762.188451:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f101b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.188463:0:5871:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f101b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432762.188470:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba735880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+42:2376:x1874258791810944:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 219us (546us total) trans 0 rc 0/0 00010000:00010000:2.0:1787432762.188471:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f101b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432762.188479:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 51 00000001:00080000:2.0:1787432762.188861:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787432762.189348:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1787432762.189486:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba88b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5871:1874258812801280:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787432762.190252:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432762.190345:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2300 going to sleep for 11 seconds 00000100:00100000:0.0:1787432762.191595:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812801280 00000100:00100000:0.0:1787432762.191777:0:5873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812801280 00000100:00100000:0.0:1787432762.192069:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432762.192083:0:5873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5871:x1874258812801280:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787432762.192533:0:5873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5871:x1874258812801280:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 450us (2281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432762.192560:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787432762.193057:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432762.193195:0:5871:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787432762.193203:0:5871:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1787432762.193230:0:5871:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff935bba889c00, transno 4294967301 00000100:00100000:3.0:1787432762.193255:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba88b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5871:1874258812801280:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787432762.194268:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1787432762.194393:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba734a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5871:1874258812801408:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787432762.194486:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432762.195061:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b8304f780 going to sleep for 11 seconds 00000100:00100000:1.0:1787432762.195410:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812801408 00000100:00100000:1.0:1787432762.195420:0:5873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812801408 00000100:00100000:1.0:1787432762.195537:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787432762.195550:0:5873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba736a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5871:x1874258812801408:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787432762.196153:0:5873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba736a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5871:x1874258812801408:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 602us (1664us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787432762.196163:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787432762.196297:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba734a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5871:1874258812801408:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787432762.196389:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1787432762.196445:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f101b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.196468:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f101b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.196477:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f101b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.196483:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432762.196489:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f101b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.196497:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f101b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.196516:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b952e8e00) 00010000:00010000:3.0:1787432762.196519:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787432762.196525:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f101b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.196531:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f101b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787432762.196845:0:5871:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787432762.197160:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1787432762.197176:0:5871:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 396862517466ns, next at 397862514966ns, rc = 0 00000001:00080000:3.0:1787432762.197184:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1787432762.197232:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b952e8e00) 00010000:00010000:3.0:1787432762.197236:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787432762.197246:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1019c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d34 expref: 46 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432762.197380:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8355c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+45:10560:x1874258791810816:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 16744us (18977us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1787432762.197391:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 26 00000020:00080000:3.0:1787432762.197395:0:5871:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787432762.201170:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432762.201574:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791811072 00000100:00100000:0.0:1787432762.201589:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791811072 00000100:00100000:0.0:1787432762.201731:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 100 00000100:00100000:0.0:1787432762.201745:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+45:10560:x1874258791811072:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787432762.201792:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432762.201835:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f101b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d3b expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.201933:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f101b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d3b expref: 46 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.202264:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f101b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d3b expref: 46 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.202291:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:0.0:1787432762.202294:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787432762.202299:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cf000, rc 0) 00000100:00100000:0.0:1787432762.202383:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+46:10560:x1874258791811072:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 641us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432762.202391:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 100 00000100:00100000:0.0:1787432762.205983:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432762.206155:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791811328 00000100:00100000:3.0:1787432762.206172:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791811328 00000100:00100000:3.0:1787432762.206251:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:3.0:1787432762.206265:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+46:10560:x1874258791811328:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:3.0:1787432762.206603:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+47:10560:x1874258791811328:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 341us (637us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1787432762.206623:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:1.0:1787432762.334232:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432762.334362:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791811456 00000100:00100000:3.0:1787432762.334378:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791811456 00000100:00100000:3.0:1787432762.334779:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 101 00000100:00100000:3.0:1787432762.334795:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+47:10570:x1874258791811456:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:3.0:1787432762.334929:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f101bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.335085:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f101bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.335113:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f101bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.335135:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f101c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.335161:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f101c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.335168:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f101c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.335318:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f101cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.335328:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f101cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.335335:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f101cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432762.335391:0:8110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f101cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.335407:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f101bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.335415:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f101bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.335423:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f101bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.335430:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432762.335434:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f101bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.335443:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f101bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.335467:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:3.0:1787432762.335470:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432762.335475:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f101bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.335481:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f101bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.335498:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f101c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.335504:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f101c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.336301:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f101c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.336320:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155c00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432762.336325:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f101c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.336332:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f101c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.336350:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff935b8304a600) 00010000:00010000:3.0:1787432762.336353:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432762.336357:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f101c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.336364:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f101c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.336408:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f101cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.336415:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f101cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.336422:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f101cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.336427:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432762.336430:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f101cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.336437:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f101cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.336445:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:3.0:1787432762.336448:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432762.336450:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f101cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.336455:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f101cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432762.337356:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+47:10570:x1874258791811456:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 2552us (3125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432762.337375:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 101 00000100:00100000:0.0:1787432762.403910:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432762.404154:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791811712 00000100:00100000:2.0:1787432762.404168:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791811712 00000100:00100000:2.0:1787432762.404274:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 102 00000100:00100000:2.0:1787432762.404287:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+47:10573:x1874258791811712:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787432762.404315:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432762.404362:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f101d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d42 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.404471:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f101db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.404492:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f101db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.404508:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f101db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.404600:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f101e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.404608:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f101e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.404804:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f101e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.405222:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f101e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.405234:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f101e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.405242:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f101e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432762.405254:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787432762.405391:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f101db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.405414:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f101db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.405421:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f101db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.405428:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432762.405434:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f101db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.405442:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f101db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.405458:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:2.0:1787432762.405462:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432762.405467:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f101db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.405472:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f101db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.405488:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f101e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.405493:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f101e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.405498:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f101e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.405503:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fa00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432762.407547:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f101e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.407568:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f101e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.407593:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff935b952e8c00) 00010000:00010000:2.0:1787432762.407596:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432762.407603:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f101e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.407621:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f101e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.407746:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f101d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d42 expref: 50 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.407775:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f101e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d42 expref: 49 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.407782:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:2.0:1787432762.407785:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432762.407788:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5fe00, rc 0) 00000100:00100000:2.0:1787432762.407921:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+49:10573:x1874258791811712:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 3635us (4024us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1787432762.407932:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 102 00000100:00100000:0.0:1787432762.414219:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432762.415705:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791811840 00000100:00100000:2.0:1787432762.415724:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791811840 00000100:00100000:2.0:1787432762.416023:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 103 00000100:00100000:2.0:1787432762.416037:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+49:10573:x1874258791811840:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:2.0:1787432762.416169:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f101f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.416205:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f101f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.416220:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f101f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.416256:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f101f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.416263:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f101f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.416271:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f101f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.416277:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432762.416282:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f101f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.416290:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f101f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.416303:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:2.0:1787432762.416305:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787432762.416311:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f101f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.416318:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f101f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432762.416454:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+49:10573:x1874258791811840:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 419us (2252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432762.416463:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 103 00000100:00100000:1.0:1787432762.420959:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432762.421457:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791812096 00000100:00100000:3.0:1787432762.421474:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791812096 00000100:00100000:3.0:1787432762.421588:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:3.0:1787432762.421639:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+49:10573:x1874258791812096:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:3.0:1787432762.422229:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+50:10573:x1874258791812096:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 592us (1297us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787432762.422240:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 28 00010000:00010000:3.0:1787432762.486001:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432762.497254:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432762.497393:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791812352 00000100:00100000:1.0:1787432762.497408:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791812352 00000100:00100000:1.0:1787432762.497488:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 104 00000100:00100000:1.0:1787432762.497500:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+50:10583:x1874258791812352:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787432762.497552:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432762.497557:0:8110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787432762.497591:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f10179 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d26 expref: 50 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.497739:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:1.0:1787432762.497746:0:8110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432762.497775:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f101fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d49 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.497927:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10205 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.497944:0:8110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f101e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d42 expref: 50 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.497954:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10205 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.497995:0:8110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f101e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d42 expref: 50 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.498012:0:8110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f101e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d42 expref: 50 pid: 5867 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432762.498046:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8110:1874258812801536:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787432762.498172:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb7d8f180 going to sleep for 11 seconds 00000100:00100000:0.0:1787432762.504089:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432762.504229:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8110:1874258812801536:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787432762.504267:0:8110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10205 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432762.504985:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791812480 00000100:00100000:3.0:1787432762.504996:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791812480 00010000:00010000:3.0:1787432762.505057:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f101e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d42 expref: 51 pid: 5867 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432762.505109:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:3.0:1787432762.505121:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb603480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+51:2376:x1874258791812480:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432762.505141:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432762.505150:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f101e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d42 expref: 51 pid: 5867 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.505165:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f101e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d42 expref: 51 pid: 5867 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.505194:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f101e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d42 expref: 51 pid: 5867 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.505217:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:3.0:1787432762.505223:0:5853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10205 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.505257:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10205 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.505266:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10205 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.505309:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432762.505393:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb603480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+50:2376:x1874258791812480:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 274us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432762.505402:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 52 00010000:00010000:0.0:1787432762.506057:0:8110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10205 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.506085:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10205 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432762.506110:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787432762.506315:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f101fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d49 expref: 51 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.506339:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10205 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d49 expref: 50 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.506349:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:0.0:1787432762.506352:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787432762.506355:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e6000, rc 0) 00000100:00100000:0.0:1787432762.506408:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+50:10583:x1874258791812352:12345-192.168.202.15@tcp:101:bash.0 Request processed in 8910us (9171us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787432762.506417:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 104 00000100:00100000:1.0:1787432762.512415:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432762.512521:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791812736 00000100:00100000:2.0:1787432762.512987:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791812736 00000100:00100000:2.0:1787432762.513074:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 105 00000100:00100000:2.0:1787432762.513086:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+50:10583:x1874258791812736:12345-192.168.202.15@tcp:36:bash.0 00010000:00010000:2.0:1787432762.513460:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10213 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.513484:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.513499:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787432762.513581:0:5867:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1787432762.513621:0:5867:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f0484b8 reply state 00000000e54a2272 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432762.513633:0:5867:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787432762.513802:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+53:10583:x1874258791812736:12345-192.168.202.15@tcp:36:bash.0 Request processed in 716us (1401us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787432762.513811:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 105 00000020:00080000:2.0:1787432762.513817:0:5867:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787432762.516836:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.516869:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10213 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.516901:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10213 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.516907:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432762.516913:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10213 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.516922:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10213 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.516944:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:2.0:1787432762.516947:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432762.516952:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10213 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.516959:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10213 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432762.519186:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432762.519276:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791812864 00000100:00100000:2.0:1787432762.519290:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791812864 00000100:00100000:2.0:1787432762.519370:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 106 00000100:00100000:2.0:1787432762.519383:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+52:10583:x1874258791812864:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787432762.519417:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432762.519444:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f1021a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d50 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.519569:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10221 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.519587:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10205 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d49 expref: 53 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.519621:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10221 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.519716:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10205 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d49 expref: 53 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.519733:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10205 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d49 expref: 53 pid: 8110 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432762.519762:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba889c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5868:1874258812801664:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432762.519878:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787432762.525901:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432762.526075:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba889c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5868:1874258812801664:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787432762.526119:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10221 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432762.526291:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791812992 00000100:00100000:0.0:1787432762.526304:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791812992 00010000:00010000:0.0:1787432762.526366:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10205 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d49 expref: 54 pid: 8110 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432762.526417:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:0.0:1787432762.526429:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba736300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+54:2375:x1874258791812992:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432762.526453:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432762.526463:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10205 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d49 expref: 54 pid: 8110 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.526506:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10205 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d49 expref: 54 pid: 8110 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.526539:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10205 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d49 expref: 54 pid: 8110 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.526558:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:0.0:1787432762.526565:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10221 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.526576:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.526585:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10221 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.526623:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432762.526738:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba736300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+53:2375:x1874258791812992:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 310us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432762.526746:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 53 00010000:00010000:3.0:1787432762.527133:0:5868:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.527144:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432762.527211:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787432762.527217:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432762.527249:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.527299:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f1021a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d50 expref: 53 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.527318:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d50 expref: 52 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.527326:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:3.0:1787432762.527343:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432762.527346:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f000, rc 0) 00000100:00100000:3.0:1787432762.527397:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+52:10583:x1874258791812864:12345-192.168.202.15@tcp:101:bash.0 Request processed in 8017us (8229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432762.527405:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 106 00000100:00100000:3.0:1787432762.535009:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432762.536126:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791813248 00000100:00100000:1.0:1787432762.536145:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791813248 00000100:00100000:1.0:1787432762.536239:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:1.0:1787432762.536251:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+52:10583:x1874258791813248:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:1.0:1787432762.537115:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+53:10583:x1874258791813248:12345-192.168.202.15@tcp:35:bash.0 Request processed in 858us (2116us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1787432762.537127:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:0.0:1787432762.642857:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432762.643081:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791813376 00000100:00100000:1.0:1787432762.643094:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791813376 00000100:00100000:1.0:1787432762.643161:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 107 00000100:00100000:1.0:1787432762.643170:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+53:10589:x1874258791813376:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787432762.643203:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432762.643229:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f10228 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d57 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.643335:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1022f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.643372:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1022f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.643385:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1022f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432762.643461:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787432762.643464:0:8110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787432762.643485:0:8110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1022f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.643522:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f10228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d57 expref: 55 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.643553:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1022f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d57 expref: 54 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.643564:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:1.0:1787432762.643567:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787432762.643571:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e6a00, rc 0) 00000100:00100000:1.0:1787432762.643948:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+54:10589:x1874258791813376:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 775us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432762.643958:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 107 00000100:00100000:3.0:1787432762.646626:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432762.646721:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791813504 00000100:00100000:0.0:1787432762.646737:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791813504 00000100:00100000:0.0:1787432762.646836:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 108 00000100:00100000:0.0:1787432762.646857:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+54:10589:x1874258791813504:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787432762.646885:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432762.646913:0:6929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f10236 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d5e expref: -99 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647021:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1023d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647039:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1023d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647053:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1023d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647072:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10244 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647079:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647086:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647215:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1024b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647224:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1024b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647231:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1024b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432762.647278:0:6929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787432762.647283:0:6929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787432762.647305:0:6929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1024b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647332:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1024b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647343:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1023d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647350:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1023d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647358:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1023d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647366:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cfa00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432762.647371:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1023d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647380:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1023d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647395:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:0.0:1787432762.647398:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432762.647402:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1023d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647409:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1023d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647424:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647430:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10244 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647446:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647451:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cf600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432762.647454:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647460:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10244 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647468:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff935b9838f600) 00010000:00010000:0.0:1787432762.647470:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432762.647473:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10244 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647478:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10244 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647529:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f10236 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d5e expref: 56 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647544:0:6929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1024b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d5e expref: 55 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.647552:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:0.0:1787432762.647554:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432762.647557:0:6929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1ce800, rc 0) 00000100:00100000:0.0:1787432762.648485:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+55:10589:x1874258791813504:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1630us (1868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432762.648514:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 108 00000100:00100000:3.0:1787432762.654602:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432762.656599:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791813632 00000100:00100000:0.0:1787432762.656621:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791813632 00000100:00100000:0.0:1787432762.656839:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:0.0:1787432762.656863:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba734e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+55:2376:x1874258791813632:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432762.656886:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432762.656922:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1024b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d5e expref: 55 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.656946:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:0.0:1787432762.656953:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432762.657049:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba734e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+54:2376:x1874258791813632:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 189us (2463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432762.657058:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:1.0:1787432762.659353:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432762.659511:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791813888 00000100:00100000:3.0:1787432762.659541:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791813888 00000100:00100000:3.0:1787432762.659618:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 109 00000100:00100000:3.0:1787432762.659631:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+54:10589:x1874258791813888:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432762.659684:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432762.659716:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f10252 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d65 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.659882:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10259 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.659901:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10221 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d50 expref: 55 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.659910:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10259 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.659955:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d50 expref: 55 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.659972:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10221 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d50 expref: 55 pid: 5868 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432762.660016:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba736680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5868:1874258812801792:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787432762.660158:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b8304f780 going to sleep for 11 seconds 00000100:00100000:2.0:1787432762.664617:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432762.664768:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba736680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5868:1874258812801792:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787432762.664808:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10259 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432762.665177:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791814016 00000100:00100000:0.0:1787432762.665188:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791814016 00010000:00010000:0.0:1787432762.665387:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10221 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d50 expref: 56 pid: 5868 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432762.665430:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 54 00000100:00100000:0.0:1787432762.665442:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b909ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+56:2376:x1874258791814016:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432762.665463:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432762.665471:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10221 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d50 expref: 56 pid: 5868 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.665485:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d50 expref: 56 pid: 5868 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.665527:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10221 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d50 expref: 56 pid: 5868 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.665547:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:0.0:1787432762.665552:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10259 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.665564:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10259 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.665573:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10259 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.665696:0:5868:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10259 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.665704:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10259 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432762.665729:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787432762.665959:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f10252 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d65 expref: 57 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.665979:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10259 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d65 expref: 56 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432762.665988:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:3.0:1787432762.665991:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787432762.665993:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154800, rc 0) 00000100:00100000:3.0:1787432762.666083:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+56:10589:x1874258791813888:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 6454us (6747us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787432762.666093:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 109 00010000:00010000:0.0:1787432762.666152:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432762.666177:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b909ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+55:2376:x1874258791814016:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 737us (1578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432762.666185:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 54 00000100:00100000:3.0:1787432762.669288:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432762.669422:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791814272 00000100:00100000:1.0:1787432762.669437:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791814272 00000100:00100000:1.0:1787432762.669630:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:1.0:1787432762.669647:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba736680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+55:10589:x1874258791814272:12345-192.168.202.15@tcp:103:lfs.0 00010000:00010000:1.0:1787432762.669719:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432762.669755:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f101b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d3b expref: 55 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432762.669777:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:1.0:1787432762.669783:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432762.669864:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba736680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+54:10589:x1874258791814272:12345-192.168.202.15@tcp:103:lfs.0 Request processed in 220us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432762.669872:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:1.0:1787432762.672790:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432762.672870:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791814400 00000100:00100000:2.0:1787432762.672882:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791814400 00000100:00100000:2.0:1787432762.672961:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 110 00000100:00100000:2.0:1787432762.673080:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+54:10589:x1874258791814400:12345-192.168.202.15@tcp:58:lfs.0 00010000:00010000:2.0:1787432762.673218:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10267 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.673241:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10267 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432762.673255:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10267 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787432762.673503:0:5867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787432762.673636:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+54:10589:x1874258791814400:12345-192.168.202.15@tcp:58:lfs.0 Request processed in 664us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432762.673645:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 110 00000100:00100000:2.0:1787432762.676200:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432762.676272:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791814528 00000100:00100000:0.0:1787432762.676283:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791814528 00000100:00100000:0.0:1787432762.676345:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 111 00000100:00100000:0.0:1787432762.676357:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+54:10589:x1874258791814528:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787432762.676384:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432762.676408:0:6929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1026e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d6c expref: -99 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.676475:0:6929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10267 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.676502:0:6929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1026e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d6c expref: 55 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.676535:0:6929:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10267 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.676550:0:6929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1026e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d6c expref: 55 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.676568:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:0.0:1787432762.676572:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787432762.676576:0:6929:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1026e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d6c expref: 55 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432762.676585:0:6929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1ce800, rc 0) 00000100:00100000:0.0:1787432762.676701:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+55:10589:x1874258791814528:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 344us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432762.676708:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 111 00010000:00010000:3.0:1787432763.514039:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787432763.642021:0:11725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787432763.642031:0:11725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787432763.642087:0:11725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787432763.642096:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787432763.642233:0:11725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba888000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11725:1874258812801920:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787432763.642678:0:11725:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432763.649036:0:11725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba888000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11725:1874258812801920:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787432763.649523:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432763.649786:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791814656 00000100:00100000:3.0:1787432763.649797:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791814656 00000100:00080000:2.0:1787432763.649890:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432763.649909:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 112 00000100:00100000:3.0:1787432763.649927:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+55:10590:x1874258791814656:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787432763.649970:0:5868:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787432763.650114:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+55:10590:x1874258791814656:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 192us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432763.650122:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 112 00000100:00100000:2.0:1787432763.659932:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432763.660029:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791814784 00000100:00100000:0.0:1787432763.660040:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791814784 00000100:00100000:0.0:1787432763.660113:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 113 00000100:00100000:0.0:1787432763.660126:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+55:10590:x1874258791814784:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787432763.660207:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10275 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660224:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10275 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660257:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10275 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660325:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1027c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660333:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1027c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660354:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1027c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660381:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10283 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660390:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660397:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432763.660438:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787432763.660443:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787432763.660456:0:5869:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660467:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10275 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660474:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10275 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660491:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10275 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660498:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cf600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432763.660502:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10275 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660510:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10275 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660524:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff935b8304a100) 00010000:00010000:0.0:1787432763.660527:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432763.660532:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10275 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660539:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10275 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660554:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1027c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660560:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1027c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660566:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1027c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660571:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cfa00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432763.660575:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1027c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660735:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1027c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660744:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff935b9838f600) 00010000:00010000:0.0:1787432763.660747:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432763.660750:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1027c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660756:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f1027c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660773:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660779:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10283 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660783:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660788:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cea00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432763.660792:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660798:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10283 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660804:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:0.0:1787432763.660807:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432763.660810:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10283 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.660828:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10283 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432763.660927:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+55:10590:x1874258791814784:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 Request processed in 802us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432763.660936:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 113 00000100:00100000:0.0:1787432763.674531:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432763.674703:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791815040 00000100:00100000:3.0:1787432763.674713:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791815040 00000100:00100000:3.0:1787432763.674783:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 114 00000100:00100000:3.0:1787432763.674794:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+55:10590:x1874258791815040:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432763.674817:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432763.674853:0:6929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f1028a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d73 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.674967:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f10291 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.674982:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f10291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.674993:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f10291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432763.675004:0:6929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787432763.675107:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f10291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.675132:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f10291 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.675139:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f10291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.675146:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432763.675151:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f10291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.675159:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f10291 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.675173:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:3.0:1787432763.675176:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787432763.675182:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f10291 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.675188:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f10291 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.675240:0:6929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f1028a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d73 expref: 57 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.675251:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff935b8304a100) 00010000:00010000:3.0:1787432763.675253:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432763.675258:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f1028a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d73 expref: 57 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.675267:0:6929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155c00, rc 0) 00000100:00100000:3.0:1787432763.675363:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+56:10590:x1874258791815040:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 569us (841us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1787432763.675371:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 114 00000100:00100000:3.0:1787432763.680726:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432763.680874:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791815168 00000100:00100000:1.0:1787432763.680894:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791815168 00000100:00100000:1.0:1787432763.680971:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 115 00000100:00100000:1.0:1787432763.680981:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+56:10590:x1874258791815168:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787432763.681289:0:5867:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787432763.682153:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+56:10590:x1874258791815168:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 1167us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432763.682165:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 115 00000100:00100000:0.0:1787432763.689100:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432763.689225:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791815424 00000100:00100000:1.0:1787432763.689237:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791815424 00000100:00100000:1.0:1787432763.689371:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 116 00000100:00100000:1.0:1787432763.689384:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+56:10590:x1874258791815424:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787432763.689408:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432763.689427:0:8110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787432763.689458:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1022f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d57 expref: 56 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.689478:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:1.0:1787432763.689484:0:8110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432763.689499:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f1029f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d7a expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787432763.690036:0:8110:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1787432763.690240:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f102a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.690254:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f102a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.690264:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f102a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.690320:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f1029f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d7a expref: 58 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.690336:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f102a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d7a expref: 57 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.690344:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff935ba2a69100) 00010000:00010000:1.0:1787432763.690347:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432763.690350:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e6200, rc 0) 00000100:00100000:1.0:1787432763.690413:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+57:10590:x1874258791815424:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 1031us (1325us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787432763.690430:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 116 00000100:00100000:0.0:1787432763.699116:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432763.699285:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791815680 00000100:00100000:2.0:1787432763.699296:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791815680 00000100:00100000:2.0:1787432763.699886:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 117 00000100:00100000:2.0:1787432763.699899:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+57:10590:x1874258791815680:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787432763.699963:0:5868:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432763.699993:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f102a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d7a expref: 57 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.700013:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff935ba2a69100) 00010000:00010000:2.0:1787432763.700026:0:5868:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432763.700116:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.700131:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.700153:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.700210:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f102bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb4eeeb8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.700218:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f102bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb4eeeb8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.700225:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f102bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb4eeeb8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.700307:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.700315:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102b4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.700322:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.700338:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fe00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432763.700795:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.700804:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.700815:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:2.0:1787432763.700818:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432763.700822:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.700849:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.700862:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f102bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb4eeeb8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.700869:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f102bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb4eeeb8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.700874:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f102bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb4eeeb8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.700879:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432763.700883:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f102bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb4eeeb8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.700889:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f102bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb4eeeb8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.700897:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb4eeeb8f (ffff935b952e8c00) 00010000:00010000:2.0:1787432763.700900:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432763.700903:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f102bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb4eeeb8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.700909:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f102bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb4eeeb8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432763.701201:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+56:10590:x1874258791815680:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 1302us (2096us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787432763.701209:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 117 00000100:00100000:1.0:1787432763.720176:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432763.720285:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791815808 00000100:00100000:2.0:1787432763.720297:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791815808 00000100:00100000:2.0:1787432763.720527:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 118 00000100:00100000:2.0:1787432763.720538:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+56:10590:x1874258791815808:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787432763.720559:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432763.720592:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f102c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d81 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.720629:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.720642:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.720654:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.720784:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f102c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d81 expref: 58 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.720801:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d81 expref: 57 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.720810:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff935b952e8c00) 00010000:00010000:2.0:1787432763.720813:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787432763.720823:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5fe00, rc 0) 00000100:00100000:2.0:1787432763.720923:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+57:10590:x1874258791815808:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 387us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432763.720931:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 118 00000100:00100000:2.0:1787432763.725132:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432763.725230:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791816064 00000100:00100000:1.0:1787432763.725240:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791816064 00000100:00100000:1.0:1787432763.725337:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 119 00000100:00100000:1.0:1787432763.725347:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+57:10590:x1874258791816064:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787432763.725437:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f102d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.725453:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f102d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.725464:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f102d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787432763.726201:0:8110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1787432763.726213:0:8110:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 398391554407ns, next at 399391551897ns, rc = 0 00000004:00010000:1.0:1787432763.726294:0:8110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017b8332e reply state 000000003596e94a transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f102d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432763.726305:0:8110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787432763.726421:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+59:10590:x1874258791816064:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 1073us (1297us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1787432763.726430:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 119 00010000:00010000:2.0:1787432763.729168:0:3317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f102d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.729186:0:3317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f102d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.729193:0:3317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f102d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.729199:0:3317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6e00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432763.729203:0:3317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f102d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.729211:0:3317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f102d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.729230:0:3317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff935b952e8c00) 00010000:00010000:2.0:1787432763.729233:0:3317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787432763.729237:0:3317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f102d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.729243:0:3317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f102d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432763.732876:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432763.733891:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791816192 00000100:00100000:3.0:1787432763.733905:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791816192 00000100:00100000:3.0:1787432763.733974:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 120 00000100:00100000:3.0:1787432763.733986:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+58:10590:x1874258791816192:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432763.734016:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432763.734041:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f102d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d88 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.734267:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f102d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d88 expref: 59 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.734282:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f102d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d88 expref: 59 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.734303:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff935b952e8c00) 00010000:00010000:3.0:1787432763.734305:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787432763.734309:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155c00, rc 0) 00000100:00100000:3.0:1787432763.734698:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+59:10590:x1874258791816192:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 713us (1832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432763.734707:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 120 00000100:00100000:3.0:1787432763.749767:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432763.750245:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791816320 00000100:00100000:1.0:1787432763.750258:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791816320 00000100:00080000:2.0:1787432763.750402:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432763.750642:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:1.0:1787432763.750690:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba737b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+8:2376:x1874258791816320:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787432763.751244:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba737b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+9:2376:x1874258791816320:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 590us (1488us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787432763.751253:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:3.0:1787432763.754883:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432763.754996:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791816576 00000100:00100000:2.0:1787432763.755007:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791816576 00000100:00100000:2.0:1787432763.755078:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:2.0:1787432763.755089:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+59:10590:x1874258791816576:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787432763.755334:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+60:10590:x1874258791816576:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 247us (463us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787432763.755653:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:2.0:1787432763.763000:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432763.763214:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791816832 00000100:00100000:1.0:1787432763.763226:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791816832 00000100:00100000:1.0:1787432763.763339:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 121 00000100:00100000:1.0:1787432763.763429:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+60:10590:x1874258791816832:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787432763.763562:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+60:10590:x1874258791816832:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 137us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432763.763571:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 121 00000100:00100000:3.0:1787432763.768023:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432763.768982:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791816960 00000100:00100000:0.0:1787432763.768994:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791816960 00000100:00100000:0.0:1787432763.770067:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 122 00000100:00100000:0.0:1787432763.770087:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+60:10590:x1874258791816960:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432763.770110:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432763.770133:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f102de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d8f expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.770213:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f102e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.770229:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f102e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.770241:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f102e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432763.770280:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787432763.770298:0:5869:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f102e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.770335:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f102de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d8f expref: 62 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.770365:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f102e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d8f expref: 61 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.770374:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff935b952e8c00) 00010000:00010000:0.0:1787432763.770377:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787432763.770380:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cf200, rc 0) 00000100:00100000:0.0:1787432763.770450:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+61:10590:x1874258791816960:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 371us (2437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432763.777487:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 122 00000100:00100000:1.0:1787432763.777640:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432763.778041:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791817088 00000100:00100000:3.0:1787432763.778172:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791817088 00000100:00100000:3.0:1787432763.778260:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:3.0:1787432763.778271:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+9:2375:x1874258791817088:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432763.778290:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432763.778314:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a67bc88e/0xbcb9e331c3f102ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d96 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432763.778351:0:6725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a0f3b, blocks: 0x1 00010000:00010000:3.0:1787432763.778371:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=398s v=(0 0) 00010000:00010000:3.0:1787432763.778376:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432763.778385:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a67bc88e/0xbcb9e331c3f102ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d96 expref: 10 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.778403:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a67bc88e/0xbcb9e331c3f102ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d96 expref: 10 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.778416:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155200, rc 0) 00000100:00100000:3.0:1787432763.778480:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+10:2375:x1874258791817088:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 211us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432763.778505:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:1.0:1787432763.783283:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432763.783450:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791817344 00000100:00100000:0.0:1787432763.783463:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791817344 00000100:00100000:0.0:1787432763.783562:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 123 00000100:00100000:0.0:1787432763.783574:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+61:10590:x1874258791817344:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787432763.783724:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+61:10590:x1874258791817344:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 151us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432763.783733:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 123 00000100:00100000:3.0:1787432763.789098:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432763.789366:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791817472 00000100:00100000:1.0:1787432763.789376:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791817472 00000100:00100000:1.0:1787432763.789439:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:1.0:1787432763.789450:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba735880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+10:10590:x1874258791817472:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787432763.789469:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432763.789491:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a3fac49/0xbcb9e331c3f102f3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025d9d expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.789526:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a67bc88e/0xbcb9e331c3f102ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d96 expref: 11 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.789537:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432763.789541:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432763.789560:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a3fac49/0xbcb9e331c3f102f3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d9d expref: 11 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.789597:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a67bc88e/0xbcb9e331c3f102ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d96 expref: 11 pid: 6725 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.789613:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a67bc88e/0xbcb9e331c3f102ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d96 expref: 11 pid: 6725 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432763.789627:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8446:1874258812802048:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787432763.789765:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb7d8f000 going to sleep for 11 seconds 00000100:00100000:1.0:1787432763.812764:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432763.813017:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791817600 00000100:00100000:2.0:1787432763.813029:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791817600 00010000:00010000:2.0:1787432763.813086:0:8489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a67bc88e/0xbcb9e331c3f102ec lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d96 expref: 12 pid: 6725 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432763.813129:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:2.0:1787432763.813138:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+12:2376:x1874258791817600:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432763.813153:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432763.813177:0:8489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a67bc88e/0xbcb9e331c3f102ec lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d96 expref: 12 pid: 6725 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.813191:0:8489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a67bc88e/0xbcb9e331c3f102ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d96 expref: 12 pid: 6725 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.813215:0:8489:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432763.813220:0:8489:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432763.813228:0:8489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a3fac49/0xbcb9e331c3f102f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d9d expref: 12 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.813238:0:8489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a3fac49/0xbcb9e331c3f102f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d9d expref: 12 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432763.813273:0:8489:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009a3fac49/0xbcb9e331c3f102f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d9d expref: 12 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432763.813301:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9555880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8489:1874258812802176:192.168.202.15@tcp:105: 00000100:00100000:2.0:1787432763.813397:0:8489:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2b40 going to sleep for 11 seconds 00010000:00010000:0.0:1787432763.814334:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a67bc88e/0xbcb9e331c3f102ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d96 expref: 12 pid: 6725 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432763.814365:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8446:1874258812802048:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787432763.814393:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a3fac49/0xbcb9e331c3f102f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025d9d expref: 11 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.814423:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e7c00, rc 0) 00000100:00100000:0.0:1787432763.814475:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba735880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+11:10590:x1874258791817472:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 25026us (25388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432763.814484:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:2.0:1787432763.828652:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9555880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8489:1874258812802176:192.168.202.15@tcp:105: 00010000:00010000:2.0:1787432763.828724:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432763.829025:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+10:2376:x1874258791817600:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 15886us (16281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432763.829038:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:1.0:1787432763.835516:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432763.837310:0:6730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791817728 00000100:00100000:1.0:1787432763.837325:0:6730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791817728 00002000:00100000:1.0:1787432763.837450:0:6730:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff935bbb5daa00 x1874258791817728/t0(0) o4->ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp:474/0 lens 504/0 e 0 to 0 dl 1787432774 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787432763.837461:0:6730:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935bbb5daa00 with x1874258791817728 ext(0->12) 00002000:00010000:1.0:1787432763.837467:0:6730:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff935bbb5daa00 00000100:00100000:1.0:1787432763.837541:0:6730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:1.0:1787432763.837551:0:6730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ee8b542c-0113-490f-a721-62606ee0807f+10:2375:x1874258791817728:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787432763.839037:0:6730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ee8b542c-0113-490f-a721-62606ee0807f+12:2375:x1874258791817728:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 Request processed in 1476us (3520us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787432763.839059:0:6730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 2 00002000:00100000:1.0:1787432763.839070:0:6730:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff935bbb5daa00 x1874258791817728/t4294967308(0) o4->ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp:474/0 lens 504/448 e 0 to 0 dl 1787432774 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787432763.839089:0:6730:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935bbb5daa00 with x1874258791817728 ext(0->12) 00002000:00010000:1.0:1787432763.839096:0:6730:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff935bbb5daa00 00000100:00100000:3.0:1787432763.842916:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432763.843221:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791817856 00000100:00100000:2.0:1787432763.843232:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791817856 00000100:00100000:2.0:1787432763.843304:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 124 00000100:00100000:2.0:1787432763.843315:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+61:10590:x1874258791817856:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787432763.901387:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+61:10590:x1874258791817856:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 Request processed in 58062us (58471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432763.901402:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 124 00000001:00080000:1.0:1787432763.901442:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967392 is committed 00000004:00080000:1.0:1787432763.901453:0:5889:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:1.0:1787432763.901470:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:1.0:1787432763.901473:0:5889:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:1.0:1787432763.901496:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:1.0:1787432763.901540:0:5889:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1787432763.901559:0:5889:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787432763.901574:0:5889:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff935ba051d780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787432763.901578:0:5889:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff935b87d5c800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff935ba051d240 00000020:00080000:1.0:1787432763.901582:0:5889:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff935b87d5cd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff935a84a04800 00000020:00080000:1.0:1787432763.901596:0:5889:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff935b909a13c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787432763.901599:0:5889:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff935b87d5cc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff935b8687c780 00000020:00080000:1.0:1787432763.901602:0:5889:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff935b87d5ce00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff935bbb541400 00000020:00080000:1.0:1787432763.902640:0:5900:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1787432763.903464:0:5900:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787432763.903544:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812802304:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787432763.903608:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432763.903717:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812802432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787432763.903756:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432763.903798:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787432763.903804:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812802560:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787432763.906306:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812802304 00000100:00100000:0.0:1787432763.906321:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812802304 00000100:00100000:0.0:1787432763.906406:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812802432 00000100:00100000:0.0:1787432763.906410:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812802432 00000100:00100000:0.0:1787432763.906434:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787432763.906444:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3331:x1874258812802304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787432763.906476:0:6724:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1787432763.906503:0:6724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ed13697/0xbcb9e331c3f102fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.906526:0:6724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a6d50f4/0xbcb9e331c3f100bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.15@tcp remote: 0x93816182a025cfc expref: 11 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.906535:0:6724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787432763.906539:0:6724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432763.906544:0:6724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ed13697/0xbcb9e331c3f102fa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.906579:0:6724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a6d50f4/0xbcb9e331c3f100bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.15@tcp remote: 0x93816182a025cfc expref: 11 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.906614:0:6724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a6d50f4/0xbcb9e331c3f100bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.15@tcp remote: 0x93816182a025cfc expref: 11 pid: 8446 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432763.906629:0:6724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb600000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6724:1874258812802688:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787432763.906728:0:6724:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b830086c0 going to sleep for 11 seconds 00000100:00080000:0.0:1787432763.906756:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432763.906773:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787432763.906781:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3332:x1874258812802432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787432763.906973:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787432763.906977:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787432764 00002000:00010000:0.0:1787432763.906980:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787432763.906982:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787432763 -> 1787432764 00002000:00010000:0.0:1787432763.906984:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787432763.907459:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432763.907504:0:6725:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1787432763.907512:0:6725:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1787432763.907680:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812802560 00000100:00100000:1.0:1787432763.907685:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812802560 00000100:00100000:1.0:1787432763.909443:0:12109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787432763.909462:0:12109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3332:x1874258812802560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787432763.909493:0:12109:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1787432763.909528:0:12109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8a0f3a, atime: 0x6a8a0f3a, ctime: 0x6a8a0f3a, blocks: 0x1 00010000:00010000:1.0:1787432763.909536:0:12109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e5216f7/0xbcb9e331c3f10301 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.909552:0:12109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=398s v=(0 0) 00010000:00010000:1.0:1787432763.909556:0:12109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432763.909562:0:12109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e5216f7/0xbcb9e331c3f10301 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.909578:0:12109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e5216f7/0xbcb9e331c3f10301 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.909590:0:12109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e5216f7/0xbcb9e331c3f10301 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.909598:0:12109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e5216f7/0xbcb9e331c3f10301 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.909636:0:12109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432763.909672:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432763.909679:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e5216f7/0xbcb9e331c3f10301 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.909688:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6c00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432763.909693:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e5216f7/0xbcb9e331c3f10301 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.909702:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e5216f7/0xbcb9e331c3f10301 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.909720:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e5216f7/0xbcb9e331c3f10301 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.909727:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e5216f7/0xbcb9e331c3f10301 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432763.909757:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432763.909759:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432763.909761:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432763.910238:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3332:x1874258812802432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3455us (6489us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787432763.910247:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787432763.910602:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000004:00080000:1.0:1787432763.911233:0:3332:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff935bbb5d8700/2, rc 0, transno 4294967309 00000100:00100000:1.0:1787432763.911244:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812802432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787432763.911494:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791817984 00000100:00100000:0.0:1787432763.911503:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791817984 00000100:00100000:0.0:1787432763.911557:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:0.0:1787432763.911566:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+12:2376:x1874258791817984:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787432763.912578:0:12109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3332:x1874258812802560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3121us (5116us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787432763.912600:0:12109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787432763.920298:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000004:00080000:0.0:1787432763.921388:0:3332:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff935bbb5d9880/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787432763.921411:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812802560:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787432763.921519:0:6724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb600000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6724:1874258812802688:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787432763.921563:0:6724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002ed13697/0xbcb9e331c3f102fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432763.921829:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791818112 00000100:00100000:0.0:1787432763.921845:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791818112 00010000:00010000:0.0:1787432763.921882:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a6d50f4/0xbcb9e331c3f100bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.15@tcp remote: 0x93816182a025cfc expref: 13 pid: 8446 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432763.921922:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:0.0:1787432763.921933:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba734e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+13:2376:x1874258791818112:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432763.921948:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432763.921954:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a6d50f4/0xbcb9e331c3f100bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.15@tcp remote: 0x93816182a025cfc expref: 13 pid: 8446 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.921968:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a6d50f4/0xbcb9e331c3f100bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.15@tcp remote: 0x93816182a025cfc expref: 13 pid: 8446 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.921994:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a6d50f4/0xbcb9e331c3f100bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.15@tcp remote: 0x93816182a025cfc expref: 13 pid: 8446 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.922011:0:5851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432763.922016:0:5851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432763.922021:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ed13697/0xbcb9e331c3f102fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.922031:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ed13697/0xbcb9e331c3f102fa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.922062:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432763.922120:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba734e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+12:2376:x1874258791818112:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 189us (1830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432763.922127:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 56 00010000:00010000:0.0:1787432763.922754:0:6724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002ed13697/0xbcb9e331c3f102fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.922765:0:6724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ed13697/0xbcb9e331c3f102fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.922775:0:6724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ed13697/0xbcb9e331c3f102fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.922782:0:6724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ed13697/0xbcb9e331c3f102fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432763.922798:0:6724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787432763.923925:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3331:x1874258812802304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17479us (20313us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787432763.923935:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:0.0:1787432763.923992:0:3331:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff935bbb5da300/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787432763.923998:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812802304:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1787432763.924137:0:5855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432763.924146:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ed13697/0xbcb9e331c3f102fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.924169:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cfc00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:3.0:1787432763.924174:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ed13697/0xbcb9e331c3f102fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.924184:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ed13697/0xbcb9e331c3f102fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.924202:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ed13697/0xbcb9e331c3f102fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.924208:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ed13697/0xbcb9e331c3f102fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432763.924230:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432763.924231:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432763.924233:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787432763.988047:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1787432763.988065:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1787432763.988075:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:3.0:1787432763.989066:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2376:x1874258791817984:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 Request processed in 77491us (78457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432763.989079:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:3.0:1787432764.006872:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432764.007124:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791818368 00000100:00100000:2.0:1787432764.007137:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791818368 00000100:00100000:2.0:1787432764.007205:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 125 00000100:00100000:2.0:1787432764.007216:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+15:10590:x1874258791818368:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787432764.007278:0:5869:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432764.007308:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f102e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d8f expref: 15 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.007328:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff935b952e8c00) 00010000:00010000:2.0:1787432764.007333:0:5869:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432764.007366:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10308 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.007398:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10308 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.007408:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10308 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432764.009001:0:5869:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038ee30f9 reply state 000000007410f3f5 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10308 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432764.009018:0:5869:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787432764.009335:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+16:10590:x1874258791818368:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 2118us (2472us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787432764.009359:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 125 00010000:00010000:2.0:1787432764.024248:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10308 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.024268:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10308 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.024275:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10308 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.024282:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432764.024287:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10308 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.024295:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10308 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.024316:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff935b952e8c00) 00010000:00010000:2.0:1787432764.024320:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432764.024325:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10308 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.024332:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10308 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432764.033011:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432764.035603:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791818496 00000100:00100000:0.0:1787432764.035623:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791818496 00000100:00100000:0.0:1787432764.035795:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:0.0:1787432764.035809:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791818496:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787432764.036283:0:6726:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787432764.036287:0:6726:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787432764 -> 1787432762 00002000:00010000:0.0:1787432764.036289:0:6726:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787432762 00002000:00010000:0.0:1787432764.036291:0:6726:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787432764 -> 1787432762 00002000:00010000:0.0:1787432764.036294:0:6726:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787432764.036377:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+7:2375:x1874258791818496:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 570us (3386us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787432764.036386:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:1.0:1787432764.040523:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432764.040675:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791818752 00000100:00100000:2.0:1787432764.040699:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791818752 00000100:00100000:2.0:1787432764.040770:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 126 00000100:00100000:2.0:1787432764.040780:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+15:10590:x1874258791818752:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787432764.041030:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1030f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.041157:0:8110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d81 expref: 15 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.041168:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1030f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.041204:0:8110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d81 expref: 15 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.041217:0:8110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d81 expref: 15 pid: 5867 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432764.041231:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba45fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8110:1874258812802816:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432764.041323:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432764.046450:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432764.046683:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba45fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8110:1874258812802816:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787432764.046711:0:8110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1030f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432764.047218:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791818880 00000100:00100000:3.0:1787432764.047228:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791818880 00010000:00010000:3.0:1787432764.047270:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d81 expref: 16 pid: 5867 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432764.047360:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:3.0:1787432764.047371:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+16:2375:x1874258791818880:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432764.047389:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432764.047396:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d81 expref: 16 pid: 5867 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.047410:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d81 expref: 16 pid: 5867 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.047433:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f102c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d81 expref: 16 pid: 5867 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.047451:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff935b952e8c00) 00010000:00010000:3.0:1787432764.047456:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1030f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.047467:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1030f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.047475:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1030f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.047520:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432764.047585:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+15:2375:x1874258791818880:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 214us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432764.047594:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 57 00010000:00010000:2.0:1787432764.047824:0:8110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1030f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.047842:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1030f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.047887:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1030f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.047895:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1030f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.047902:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1030f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.047907:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432764.047912:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1030f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.047919:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1030f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.047929:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff935b952e8c00) 00010000:00010000:2.0:1787432764.047932:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787432764.047935:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1030f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.047941:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1030f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432764.048002:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+14:10590:x1874258791818752:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 Request processed in 7223us (7488us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787432764.048011:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 126 00000100:00100000:1.0:1787432764.052511:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432764.052607:0:12109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791819008 00000100:00100000:2.0:1787432764.052618:0:12109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791819008 00000100:00100000:2.0:1787432764.052786:0:12109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:2.0:1787432764.052823:0:12109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+7:2376:x1874258791819008:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787432764.052882:0:12109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4bc1692/0xbcb9e331c3f10316 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.052904:0:12109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a3fac49/0xbcb9e331c3f102f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025d9d expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.052913:0:12109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432764.052918:0:12109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432764.052923:0:12109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4bc1692/0xbcb9e331c3f10316 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.052961:0:12109:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a3fac49/0xbcb9e331c3f102f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x93816182a025d9d expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.052978:0:12109:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a3fac49/0xbcb9e331c3f102f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025d9d expref: 7 pid: 8446 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432764.052993:0:12109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba45fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12109:1874258812802944:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432764.053093:0:12109:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432764.059313:0:12109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba45fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12109:1874258812802944:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787432764.059352:0:12109:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4bc1692/0xbcb9e331c3f10316 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432764.062005:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432764.062250:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791819136 00000100:00100000:0.0:1787432764.062260:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791819136 00010000:00010000:0.0:1787432764.062303:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a3fac49/0xbcb9e331c3f102f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025d9d expref: 8 pid: 8446 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432764.062352:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 58 00000100:00100000:0.0:1787432764.062363:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+8:2376:x1874258791819136:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432764.062379:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432764.062406:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a3fac49/0xbcb9e331c3f102f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025d9d expref: 8 pid: 8446 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.062421:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a3fac49/0xbcb9e331c3f102f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025d9d expref: 8 pid: 8446 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.062471:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a3fac49/0xbcb9e331c3f102f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025d9d expref: 8 pid: 8446 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.062486:0:5851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432764.062491:0:5851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432764.062497:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4bc1692/0xbcb9e331c3f10316 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.062507:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4bc1692/0xbcb9e331c3f10316 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.062540:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432764.062604:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+7:2376:x1874258791819136:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 243us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432764.062612:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 58 00010000:00010000:2.0:1787432764.062698:0:12109:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4bc1692/0xbcb9e331c3f10316 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.062714:0:12109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4bc1692/0xbcb9e331c3f10316 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.062741:0:12109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4bc1692/0xbcb9e331c3f10316 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.062749:0:12109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4bc1692/0xbcb9e331c3f10316 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.062757:0:12109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4bc1692/0xbcb9e331c3f10316 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.062764:0:12109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fc00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432764.062768:0:12109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4bc1692/0xbcb9e331c3f10316 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.062776:0:12109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4bc1692/0xbcb9e331c3f10316 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.062787:0:12109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4bc1692/0xbcb9e331c3f10316 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.062794:0:12109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4bc1692/0xbcb9e331c3f10316 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432764.062865:0:12109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+6:2376:x1874258791819008:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 Request processed in 10055us (10364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432764.062873:0:12109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:0.0:1787432764.068983:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432764.069639:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791819392 00000100:00100000:1.0:1787432764.069652:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791819392 00000100:00100000:1.0:1787432764.069757:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 127 00000100:00100000:1.0:1787432764.069767:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+14:10590:x1874258791819392:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787432764.069867:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1031d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432764.069887:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1031d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432764.069899:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1031d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432764.070267:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f10324 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432764.070280:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f102d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d88 expref: 15 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432764.070289:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f10324 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432764.070326:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f102d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d88 expref: 15 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432764.070359:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f102d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d88 expref: 15 pid: 5868 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432764.070374:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b98b1a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5867:1874258812803072:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787432764.070466:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb7d8fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432764.075540:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b98b1a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5867:1874258812803072:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787432764.075574:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f10324 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432764.079191:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432764.079546:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791819520 00000100:00100000:1.0:1787432764.079555:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791819520 00010000:00010000:1.0:1787432764.079596:0:8489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f102d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d88 expref: 16 pid: 5868 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432764.079640:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:1.0:1787432764.079651:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb602d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+16:2375:x1874258791819520:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432764.079704:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432764.079713:0:8489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f102d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d88 expref: 16 pid: 5868 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432764.079727:0:8489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f102d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d88 expref: 16 pid: 5868 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432764.079762:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f102d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d88 expref: 16 pid: 5868 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432764.079778:0:8489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff935b952e8c00) 00010000:00010000:1.0:1787432764.079783:0:8489:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f10324 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432764.079809:0:8489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f10324 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432764.079815:0:8489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f10324 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432764.079906:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432764.079962:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb602d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+15:2375:x1874258791819520:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 312us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432764.079970:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 59 00010000:00010000:2.0:1787432764.082732:0:5867:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f10324 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.082756:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f10324 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787432764.082986:0:5867:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1787432764.083908:0:5867:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787432764.083981:0:5867:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1787432764.084296:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba45fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5867:1874258812803200:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787432764.084369:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432764.084414:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2300 going to sleep for 11 seconds 00000100:00100000:1.0:1787432764.084810:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812803200 00000100:00100000:1.0:1787432764.084839:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812803200 00000100:00100000:1.0:1787432764.084907:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787432764.084918:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5867:x1874258812803200:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787432764.085086:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5867:x1874258812803200:12345-0@lo:1000:mdt00_000.0 Request processed in 169us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432764.085094:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787432764.086742:0:5867:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1787432764.086764:0:5867:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1787432764.086789:0:5867:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff935bbb5d8700, transno 4294967309 00000100:00100000:3.0:1787432764.086810:0:5867:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff935bbb5da300 x1874258812802304/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787432779 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432764.086842:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba45fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5867:1874258812803200:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787432764.087713:0:5867:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1787432764.087882:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9554e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5867:1874258812803328:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787432764.087955:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432764.088104:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b947fdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432764.088754:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812803328 00000100:00100000:0.0:1787432764.088763:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812803328 00000100:00100000:0.0:1787432764.088826:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787432764.088847:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5867:x1874258812803328:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787432764.089359:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5867:x1874258812803328:12345-0@lo:1000:mdt00_000.0 Request processed in 515us (1402us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787432764.089367:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787432764.089419:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9554e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5867:1874258812803328:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787432764.089473:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f10324 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.089484:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f10324 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.089492:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f10324 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.089498:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e7600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432764.089502:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f10324 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.089510:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f10324 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.089527:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff935b952e8c00) 00010000:00010000:0.0:1787432764.089530:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787432764.089535:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f10324 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.089541:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f10324 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.089576:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10267 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.089582:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10267 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.089588:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10267 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.089603:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fa00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432764.089606:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10267 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.089612:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10267 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.089620:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:0.0:1787432764.089623:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787432764.089630:0:5867:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1026e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d6c expref: 18 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.089641:0:5867:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1026e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d6c expref: 18 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.089650:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1026e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d6c expref: 18 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.089895:0:5867:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1026e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d6c expref: 18 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432764.089912:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb601880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5867:1874258812803456:192.168.202.15@tcp:105: 00000100:00100000:0.0:1787432764.090205:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b83008a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432764.100578:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432764.100713:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791819648 00000100:00100000:2.0:1787432764.100724:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791819648 00000100:00100000:2.0:1787432764.100804:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:2.0:1787432764.100816:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+19:10589:x1874258791819648:12345-192.168.202.15@tcp:49:lfs.0 00000100:00100000:2.0:1787432764.100973:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+19:10589:x1874258791819648:12345-192.168.202.15@tcp:49:lfs.0 Request processed in 159us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432764.100982:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:3.0:1787432764.101757:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb601880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5867:1874258812803456:192.168.202.15@tcp:105: 00010000:00010000:3.0:1787432764.101792:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10267 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.101803:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10267 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.101952:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1032b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.101967:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1032b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.101979:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1032b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.102011:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1032b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.102017:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1032b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.102023:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1032b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.102029:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432764.102033:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1032b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.102277:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1032b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.102292:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:3.0:1787432764.102295:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432764.102298:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1032b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.102304:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1032b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.102318:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1031d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.102323:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1031d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.102328:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1031d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.102340:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432764.102343:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1031d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.102350:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1031d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.102360:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:3.0:1787432764.102362:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787432764.102366:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1031d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432764.102371:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1031d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432764.102617:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+18:10590:x1874258791819392:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 32849us (33642us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1787432764.102627:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 127 00000020:00080000:3.0:1787432764.102632:0:5867:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787432764.103526:0:11725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787432764.103533:0:11725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787432764.104414:0:11725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787432764.104484:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787432764.109988:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432764.110047:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432764.110332:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791819904 00000100:00100000:2.0:1787432764.110350:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791819904 00000100:00100000:2.0:1787432764.110408:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00100000:2.0:1787432764.110418:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8355d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+18:10590:x1874258791819904:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787432764.111148:0:5870:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787432764.111238:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1787432764.111275:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10332 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.111288:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.111297:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.111302:0:5870:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10332 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.111306:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10332 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.111310:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10332 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.111331:0:5870:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787432764.111369:0:11210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432764.111382:0:11210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10332 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.111388:0:11210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e000 already unused, calling callback (ffffffffc1752230) 00010000:00010000:0.0:1787432764.111392:0:11210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10332 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.111399:0:11210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10332 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.111411:0:11210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff935b952e8000) 00010000:00010000:0.0:1787432764.111414:0:11210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787432764.111418:0:11210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10332 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.111424:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10332 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432764.111430:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8355d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+20:10590:x1874258791819904:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 1011us (1454us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787432764.111437:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 32 00010000:00010000:0.0:1787432764.111440:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787432764.111442:0:5870:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787432764.111442:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432764.111444:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432764.112084:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791820160 00000100:00100000:3.0:1787432764.112092:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791820160 00000100:00100000:3.0:1787432764.112140:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 128 00000100:00100000:3.0:1787432764.112150:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+20:10589:x1874258791820160:12345-192.168.202.15@tcp:58:lfs.0 00000040:00080000:3.0:1787432764.112372:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787432764.112715:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+20:10589:x1874258791820160:12345-192.168.202.15@tcp:58:lfs.0 Request processed in 564us (2665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432764.112723:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 128 00000100:00100000:0.0:1787432764.153104:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432764.153791:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791820288 00000100:00100000:2.0:1787432764.153804:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791820288 00000100:00100000:2.0:1787432764.154065:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 129 00000100:00100000:2.0:1787432764.154076:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+20:10592:x1874258791820288:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787432764.154104:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432764.154129:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10339 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025da4 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.154210:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10340 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.154224:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10340 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.154236:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10340 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.154252:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10347 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.154258:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.154265:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.157694:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1034e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.157729:0:8110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10259 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d65 expref: 21 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.157740:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1034e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.158109:0:8110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10259 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d65 expref: 21 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.158128:0:8110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10259 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d65 expref: 21 pid: 5868 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432764.158144:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba45fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8110:1874258812803584:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432764.158317:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2300 going to sleep for 11 seconds 00000100:00100000:0.0:1787432764.166336:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba45fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8110:1874258812803584:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787432764.166382:0:8110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1034e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432764.173848:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432764.174393:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791820544 00000100:00100000:1.0:1787432764.174404:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791820544 00000100:00100000:1.0:1787432764.174470:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:1.0:1787432764.174481:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+22:5617:x1874258791820544:12345-192.168.202.15@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787432764.176100:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+23:5617:x1874258791820544:12345-192.168.202.15@tcp:35:ldlm_bl.0 Request processed in 1610us (2263us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1787432764.176135:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:2.0:1787432764.184613:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432764.188134:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791820672 00000100:00100000:0.0:1787432764.188151:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791820672 00010000:00010000:0.0:1787432764.189066:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10259 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d65 expref: 23 pid: 5868 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432764.189219:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:0.0:1787432764.189233:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b909b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+23:2376:x1874258791820672:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432764.189259:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432764.189267:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10259 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d65 expref: 23 pid: 5868 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.189280:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10259 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d65 expref: 23 pid: 5868 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.189311:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10259 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025d65 expref: 23 pid: 5868 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.189330:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:0.0:1787432764.189335:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1034e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.189358:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1034e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.189367:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1034e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432764.190096:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432764.190167:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b909b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+22:2376:x1874258791820672:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 936us (5572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432764.190178:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 60 00010000:00010000:2.0:1787432764.194757:0:8110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1034e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.194775:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1034e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432764.194839:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787432764.194845:0:8110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787432764.194868:0:8110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1034e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.194883:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1034e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.194901:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10340 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.194909:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10340 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.194916:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10340 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.194939:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432764.194944:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10340 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.194952:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10340 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.194967:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:2.0:1787432764.194970:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432764.194973:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10340 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.194979:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10340 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.194995:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.195002:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10347 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.195008:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10347 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.195013:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432764.195015:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10347 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.195021:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10347 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.195036:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff935b952e8700) 00010000:00010000:2.0:1787432764.195038:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432764.195041:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10347 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.195047:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10347 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.195087:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10339 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025da4 expref: 22 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.195100:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1034e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025da4 expref: 21 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432764.195107:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:2.0:1787432764.195109:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432764.195112:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e800, rc 0) 00000100:00100000:2.0:1787432764.195710:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+21:10592:x1874258791820288:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 41632us (42613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432764.195720:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 129 00010000:00010000:1.0:1787432764.537464:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432764.663222:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3331:1874258812803840:0@lo:400:kworker.0 00000100:00100000:2.0:1787432764.663302:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432764.663350:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812804352:0@lo:400:kworker.0 00000100:00100000:2.0:1787432764.663377:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432764.663411:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787432764.663417:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba45fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812803712:0@lo:400:kworker.0 00000100:00100000:2.0:1787432764.663472:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432764.663834:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812804224:0@lo:400:kworker.0 00000100:00100000:2.0:1787432764.663865:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432764.663896:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3332:1874258812803968:0@lo:400:kworker.0 00000100:00100000:2.0:1787432764.663921:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432764.663941:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787432764.663947:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812804096:0@lo:400:kworker.0 00000100:00100000:2.0:1787432764.663968:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432764.664002:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812804352 00000100:00100000:2.0:1787432764.664009:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812804352 00000100:00100000:2.0:1787432764.664332:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812804096 00000100:00100000:2.0:1787432764.664336:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812804096 00000100:00100000:2.0:1787432764.664373:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787432764.664382:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3331:x1874258812804352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432764.664438:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3331:x1874258812804352:12345-0@lo:400:kworker.0 Request processed in 58us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432764.664445:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787432764.664462:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787432764.664468:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3332:x1874258812804096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432764.664762:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3332:x1874258812804096:12345-0@lo:400:kworker.0 Request processed in 293us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432764.664770:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787432764.664794:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812803712 00000100:00100000:2.0:1787432764.664799:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812803712 00000100:00100000:2.0:1787432764.664846:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787432764.664854:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3331:x1874258812803712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432764.664899:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3331:x1874258812803712:12345-0@lo:400:kworker.0 Request processed in 47us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432764.664906:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787432764.664934:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812803840 00000100:00100000:2.0:1787432764.664939:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812803840 00000100:00100000:2.0:1787432764.664965:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812804224 00000100:00100000:2.0:1787432764.664968:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812804224 00000100:00100000:2.0:1787432764.665400:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812803968 00000100:00100000:2.0:1787432764.665405:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812803968 00000100:00100000:2.0:1787432764.665426:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787432764.665433:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3331:x1874258812803840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432764.665472:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3331:x1874258812803840:12345-0@lo:400:kworker.0 Request processed in 39us (2170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432764.665478:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787432764.665568:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787432764.665578:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812804224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432764.665617:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812804224:12345-0@lo:400:kworker.0 Request processed in 41us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432764.665623:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787432764.665633:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787432764.665639:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1874258812803968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432764.665690:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1874258812803968:12345-0@lo:400:kworker.0 Request processed in 51us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432764.665696:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:2.0:1787432764.665727:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787432764.665732:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787432764.667719:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812804096:0@lo:400:kworker.0 00000100:00100000:2.0:1787432764.667888:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3332:1874258812803968:0@lo:400:kworker.0 00000100:00100000:2.0:1787432764.667936:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba45fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812803712:0@lo:400:kworker.0 00000100:00100000:2.0:1787432764.667949:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812804224:0@lo:400:kworker.0 00000100:00100000:2.0:1787432764.667963:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3331:1874258812803840:0@lo:400:kworker.0 00000100:00100000:2.0:1787432764.667975:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812804352:0@lo:400:kworker.0 00000040:00080000:1.0:1787432765.111244:0:11725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787432765.111254:0:11725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787432765.111293:0:11725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787432765.111299:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787432765.111426:0:11725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b98b19f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11725:1874258812804480:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787432765.111522:0:11725:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb7d8fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432765.116401:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432765.116541:0:11725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b98b19f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11725:1874258812804480:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787432765.116780:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791820800 00000100:00100000:0.0:1787432765.116793:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791820800 00000100:00100000:0.0:1787432765.116906:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 130 00000100:00100000:0.0:1787432765.116916:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+21:10604:x1874258791820800:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787432765.116964:0:5869:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787432765.117183:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+21:10604:x1874258791820800:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 267us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432765.117192:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 130 00000100:00080000:2.0:1787432765.117355:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432765.125218:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432765.125274:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791821056 00000100:00100000:3.0:1787432765.125291:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791821056 00000100:00100000:3.0:1787432765.125356:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 131 00000100:00100000:3.0:1787432765.125366:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+21:10604:x1874258791821056:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432765.125387:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432765.125407:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10355 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025dab expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432765.125521:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f1035c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432765.125536:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f1035c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432765.125548:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f1035c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432765.125561:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787432765.125718:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10355 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025dab expref: 24 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432765.125748:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f1035c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025dab expref: 23 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432765.125756:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:3.0:1787432765.125759:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432765.125762:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154800, rc 0) 00000100:00100000:3.0:1787432765.125836:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+23:10604:x1874258791821056:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 458us (614us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787432765.125844:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 131 00000100:00100000:2.0:1787432765.130874:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432765.130966:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432765.130998:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791821440 00000100:00100000:2.0:1787432765.131008:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791821440 00000100:00100000:2.0:1787432765.131073:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 132 00000100:00100000:2.0:1787432765.131083:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+23:10604:x1874258791821440:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787432765.131250:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f1036a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.131269:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f1036a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.131282:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f1036a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.131504:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f1036a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.131520:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f1036a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.131528:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f1036a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.131534:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432765.131539:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f1036a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.131546:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f1036a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.131558:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:2.0:1787432765.131561:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787432765.131566:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f1036a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.131571:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f1036a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432765.131783:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+24:10604:x1874258791821440:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 698us (813us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787432765.131792:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 132 00000040:00080000:2.0:1787432765.131987:0:11725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787432765.131993:0:11725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1787432765.132151:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791821184 00000100:00100000:0.0:1787432765.132160:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791821184 00000100:00100000:0.0:1787432765.132206:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:0.0:1787432765.132214:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+24:2375:x1874258791821184:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432765.132226:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432765.132242:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f1035c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025dab expref: 24 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432765.132256:0:8489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:0.0:1787432765.132259:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432765.132298:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+23:2375:x1874258791821184:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 77us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432765.132306:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000040:00080000:2.0:1787432765.134027:0:11725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787432765.134633:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787432765.137344:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432765.139362:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791821696 00000100:00100000:0.0:1787432765.139378:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791821696 00000100:00100000:0.0:1787432765.139458:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:0.0:1787432765.139469:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+23:10604:x1874258791821696:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787432765.139770:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+24:10604:x1874258791821696:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 301us (2435us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787432765.139788:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 34 00000040:00080000:1.0:1787432765.162570:0:12147:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787432765.162579:0:12147:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787432765.162625:0:12147:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787432765.162631:0:12147:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787432765.175041:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812804608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432765.175114:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432765.175246:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432765.175254:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812804736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432765.175279:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432765.175337:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812804608 00000100:00100000:2.0:1787432765.175354:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812804608 00000100:00100000:2.0:1787432765.175397:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812804736 00000100:00100000:2.0:1787432765.175400:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812804736 00000100:00100000:2.0:1787432765.175424:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787432765.175431:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb602d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3332:x1874258812804608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432765.175464:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432765.175505:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb602d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3332:x1874258812804608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432765.175512:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787432765.175526:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787432765.175531:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3332:x1874258812804736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432765.175540:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787432765.175559:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3332:x1874258812804736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 28us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432765.175565:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1787432765.175577:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787432765.175691:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812804736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432765.175709:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812804608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432765.406005:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432765.406123:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791821952 00000100:00100000:2.0:1787432765.406134:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791821952 00000100:00100000:2.0:1787432765.406206:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 133 00000100:00100000:2.0:1787432765.406217:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+24:10617:x1874258791821952:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787432765.406246:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432765.406269:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10371 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025db2 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.406375:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10378 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.406392:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10378 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.406420:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10378 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432765.406435:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787432765.406570:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10371 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025db2 expref: 27 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.406591:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10378 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025db2 expref: 26 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.406600:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:2.0:1787432765.406603:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787432765.406606:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5fc00, rc 0) 00000100:00100000:2.0:1787432765.406744:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+26:10617:x1874258791821952:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 528us (749us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1787432765.406752:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 133 00000100:00100000:0.0:1787432765.414943:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432765.415452:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791822080 00000100:00100000:2.0:1787432765.415464:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791822080 00000100:00100000:2.0:1787432765.415529:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 134 00000100:00100000:2.0:1787432765.415541:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+26:10617:x1874258791822080:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:2.0:1787432765.415608:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10386 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.415626:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10386 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.415638:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10386 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.415726:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10386 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.415744:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10386 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.415751:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10386 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.415757:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432765.415761:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10386 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.415769:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10386 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.415782:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:2.0:1787432765.415785:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787432765.415790:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10386 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432765.415796:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10386 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432765.415878:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+26:10617:x1874258791822080:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 339us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432765.415886:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 134 00010000:00010000:3.0:1787432765.557930:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432765.584962:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432765.585042:0:12109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791822208 00000100:00100000:1.0:1787432765.585054:0:12109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791822208 00000100:00100000:1.0:1787432765.585188:0:12109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:1.0:1787432765.585213:0:12109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+6:2378:x1874258791822208:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:1.0:1787432765.585231:0:12109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432765.585251:0:12109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e8213ba/0xbcb9e331c3f1038d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025db9 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787432765.585278:0:12109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8a0f3a, atime: 0x6a8a0f3a, ctime: 0x6a8a0f3a, blocks: 0xb 00010000:00010000:1.0:1787432765.585298:0:12109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787432765.585303:0:12109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432765.585321:0:12109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e8213ba/0xbcb9e331c3f1038d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025db9 expref: 7 pid: 12109 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432765.585360:0:12109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e8213ba/0xbcb9e331c3f1038d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025db9 expref: 7 pid: 12109 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432765.585373:0:12109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e7e00, rc 0) 00000100:00100000:1.0:1787432765.585438:0:12109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+7:2378:x1874258791822208:12345-192.168.202.15@tcp:101:cat.0 Request processed in 228us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432765.585445:0:12109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:1.0:1787432765.589942:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432765.590708:0:6731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791822336 00000100:00100000:3.0:1787432765.591043:0:6731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791822336 00002000:00100000:3.0:1787432765.591111:0:6731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff935b98b19f80 x1874258791822336/t0(0) o3->ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp:476/0 lens 488/0 e 0 to 0 dl 1787432776 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787432765.591123:0:6731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935b98b19f80 with x1874258791822336 ext(0->4095) 00002000:00010000:3.0:1787432765.591129:0:6731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff935b98b19f80 00000100:00100000:3.0:1787432765.591233:0:6731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:3.0:1787432765.591245:0:6731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ee8b542c-0113-490f-a721-62606ee0807f+7:2376:x1874258791822336:12345-192.168.202.15@tcp:3:cat.0 00000100:00100000:3.0:1787432765.591496:0:6731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ee8b542c-0113-490f-a721-62606ee0807f+7:2376:x1874258791822336:12345-192.168.202.15@tcp:3:cat.0 Request processed in 252us (1573us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787432765.591504:0:6731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 3 00002000:00100000:3.0:1787432765.591616:0:6731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff935b98b19f80 x1874258791822336/t0(0) o3->ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp:476/0 lens 488/4536 e 0 to 0 dl 1787432776 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787432765.591626:0:6731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935b98b19f80 with x1874258791822336 ext(0->4095) 00002000:00010000:3.0:1787432765.591631:0:6731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff935b98b19f80 00000100:00080000:2.0:1787432765.600681:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787432766.282719:0:6749:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1787432766.290177:0:6749:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1787432766.391419:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432766.391459:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432766.391496:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432766.391534:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432766.391568:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791822848 00000100:00100000:0.0:1787432766.391579:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791822848 00000100:00100000:0.0:1787432766.391645:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791822592 00000100:00100000:0.0:1787432766.391649:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791822592 00000100:00100000:3.0:1787432766.391683:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791822464 00000100:00100000:3.0:1787432766.391698:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791822464 00000100:00100000:0.0:1787432766.391704:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 147 00000100:00100000:0.0:1787432766.391718:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2377:x1874258791822848:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432766.391740:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 292 00000100:00100000:3.0:1787432766.391750:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2378:x1874258791822464:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432766.391847:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791822720 00000100:00100000:1.0:1787432766.391853:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791822720 00000100:00100000:1.0:1787432766.391890:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 80 00000100:00100000:1.0:1787432766.391898:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2377:x1874258791822720:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432766.391951:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2377:x1874258791822848:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 236us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432766.391959:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 147 00000100:00100000:2.0:1787432766.392092:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 148 00000100:00100000:2.0:1787432766.392117:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+26:2378:x1874258791822592:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432766.398962:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2378:x1874258791822464:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 7190us (7530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432766.398979:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 292 00000100:00080000:3.0:1787432766.399103:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787432766.399110:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432766.401310:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2377:x1874258791822720:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 9400us (9800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432766.401327:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 80 00000100:00100000:2.0:1787432766.402171:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+26:2378:x1874258791822592:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 10049us (10627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432766.402185:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 148 00010000:00010000:0.0:1787432766.584204:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432767.608140:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787432768.247230:0:11725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787432768.247240:0:11725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787432768.247305:0:11725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787432768.247314:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787432768.631379:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787432769.384468:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:1.0:1787432769.384508:0:5889:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1787432769.384544:0:5900:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:2.0:1787432769.384562:0:5900:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1787432769.384625:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1787432769.384702:0:5889:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff935a8781aa80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787432769.384709:0:5889:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff935b87d5cf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff935a8781af00 00000020:00080000:1.0:1787432769.384713:0:5889:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff935b87d5c400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff935bbb49c000 00000020:00080000:2.0:1787432769.385317:0:5900:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787432769.385643:0:5900:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1787432769.386142:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1787432769.386155:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:3.0:1787432769.654908:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432769.782179:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3331:1874258812804992:0@lo:400:kworker.0 00000100:00100000:0.0:1787432769.782285:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432769.782350:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3332:1874258812805120:0@lo:400:kworker.0 00000100:00100000:1.0:1787432769.782393:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812805248:0@lo:400:kworker.0 00000100:00100000:3.0:1787432769.782430:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba45fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812804864:0@lo:400:kworker.0 00000100:00100000:1.0:1787432769.782445:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432769.782512:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812804992 00000100:00100000:2.0:1787432769.782524:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812804992 00000100:00100000:2.0:1787432769.782604:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787432769.782615:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3331:x1874258812804992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432769.787433:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432769.787544:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812805376:0@lo:400:kworker.0 00000100:00100000:3.0:1787432769.787632:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432769.787687:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787432769.787707:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812805504:0@lo:400:kworker.0 00000100:00100000:3.0:1787432769.787748:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432769.787814:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812805376 00000100:00100000:3.0:1787432769.787823:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812805376 00000100:00100000:3.0:1787432769.787899:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787432769.787911:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812805376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432769.788079:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812805376:12345-0@lo:400:kworker.0 Request processed in 169us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432769.788089:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787432769.788119:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812805248 00000100:00100000:3.0:1787432769.788124:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812805248 00000100:00100000:3.0:1787432769.788170:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812805504 00000100:00100000:3.0:1787432769.788174:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812805504 00000100:00100000:3.0:1787432769.788198:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787432769.788205:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812805248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432769.788267:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812805248:12345-0@lo:400:kworker.0 Request processed in 62us (5820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432769.788275:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787432769.788287:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787432769.788294:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba866680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812805504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432769.788323:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba866680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812805504:12345-0@lo:400:kworker.0 Request processed in 30us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432769.788329:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1787432769.788346:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432769.788351:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787432769.788355:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432769.788407:0:3330:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1787432769.788415:0:3330:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff935bbb5da300, transno 4294967310 00000004:00080000:3.0:1787432769.788431:0:3330:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1787432769.788464:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812805504:0@lo:400:kworker.0 00000100:00100000:3.0:1787432769.788479:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812805376:0@lo:400:kworker.0 00000100:00100000:3.0:1787432769.789565:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812804864 00000100:00100000:3.0:1787432769.789581:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812804864 00000100:00100000:3.0:1787432769.789640:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787432769.789650:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812804864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432769.789906:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812804864:12345-0@lo:400:kworker.0 Request processed in 257us (2486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432769.789914:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787432769.789994:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba45fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812804864:0@lo:400:kworker.0 00000100:00100000:1.0:1787432769.790276:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432769.790381:0:3333:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787432769.790388:0:3333:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1787432769.790410:0:3333:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff935bbb5d9880, transno 4294967304 00000100:00100000:1.0:1787432769.790456:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812805248:0@lo:400:kworker.0 00000100:00100000:2.0:1787432769.790854:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3331:x1874258812804992:12345-0@lo:400:kworker.0 Request processed in 8237us (8566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432769.790873:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3331:1874258812804992:0@lo:400:kworker.0 00000100:00100000:2.0:1787432769.790877:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787432769.790903:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812805120 00000100:00100000:2.0:1787432769.790909:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812805120 00000100:00080000:0.0:1787432769.791576:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432769.794203:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787432769.794243:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1874258812805120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432769.794405:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1874258812805120:12345-0@lo:400:kworker.0 Request processed in 183us (4128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432769.794414:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787432769.794481:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3332:1874258812805120:0@lo:400:kworker.0 00000100:00100000:0.0:1787432770.294824:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812805760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432770.294938:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432770.295104:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812805760 00000100:00100000:2.0:1787432770.295116:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812805760 00000100:00100000:2.0:1787432770.295215:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787432770.295249:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812805760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432770.295300:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432770.295360:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812805760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432770.295367:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787432770.295714:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812805632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432770.295763:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432770.295855:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812805760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432770.295927:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812805632 00000100:00100000:3.0:1787432770.295942:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812805632 00000100:00100000:3.0:1787432770.296009:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787432770.296018:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812805632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432770.296047:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787432770.296101:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812805632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432770.296108:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787432770.296741:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812805632:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787432770.678141:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432771.510629:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432771.510702:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432771.510739:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432771.510757:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432771.510789:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432771.510994:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791822976 00000100:00100000:3.0:1787432771.511005:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791822976 00000100:00100000:3.0:1787432771.511071:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 294 00000100:00100000:3.0:1787432771.511080:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2378:x1874258791822976:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432771.511157:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2378:x1874258791822976:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 78us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432771.511164:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 294 00000100:00100000:3.0:1787432771.511199:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791823488 00000100:00100000:3.0:1787432771.511203:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791823488 00000100:00100000:3.0:1787432771.511245:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791823104 00000100:00100000:3.0:1787432771.511248:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791823104 00000100:00100000:3.0:1787432771.511271:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 152 00000100:00100000:3.0:1787432771.511277:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2378:x1874258791823488:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432771.511307:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2378:x1874258791823488:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 31us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432771.511314:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 152 00000100:00100000:3.0:1787432771.511326:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 153 00000100:00100000:3.0:1787432771.511332:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+13:2378:x1874258791823104:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432771.511357:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+13:2378:x1874258791823104:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 24us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432771.511377:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 153 00000100:00100000:3.0:1787432771.511401:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791823232 00000100:00100000:3.0:1787432771.511405:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791823232 00000100:00100000:3.0:1787432771.511432:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791823360 00000100:00100000:3.0:1787432771.511435:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791823360 00000100:00100000:3.0:1787432771.511456:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 83 00000100:00100000:3.0:1787432771.511463:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+5:2378:x1874258791823232:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432771.511493:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+5:2378:x1874258791823232:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 30us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432771.511500:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 83 00000100:00100000:3.0:1787432771.511512:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00100000:3.0:1787432771.511518:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2378:x1874258791823360:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432771.511542:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2378:x1874258791823360:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 24us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432771.511548:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00080000:3.0:1787432771.511715:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432771.511720:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787432771.511723:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787432771.705534:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432771.740224:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432771.740487:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791823616 00000100:00100000:3.0:1787432771.740499:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791823616 00000100:00100000:3.0:1787432771.740576:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 135 00000100:00100000:3.0:1787432771.740587:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+13:10269:x1874258791823616:12345-192.168.202.15@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787432771.740776:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+13:10269:x1874258791823616:12345-192.168.202.15@tcp:60:lhsmtool_posix.0 Request processed in 189us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432771.740800:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 135 00000100:00100000:3.0:1787432771.748653:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432771.748908:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791823872 00000100:00100000:0.0:1787432771.748919:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791823872 00000100:00100000:0.0:1787432771.748984:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:0.0:1787432771.748994:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+13:10269:x1874258791823872:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787432771.749551:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+14:10269:x1874258791823872:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 556us (908us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787432771.749559:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:1.0:1787432772.219538:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432772.219719:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791824000 00000100:00100000:3.0:1787432772.219734:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791824000 00000100:00100000:3.0:1787432772.219847:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 136 00000100:00100000:3.0:1787432772.219863:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:11069:x1874258791824000:12345-192.168.202.15@tcp:101:lsof.0 00010000:00010000:3.0:1787432772.219892:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432772.219921:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f10394 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025dc0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432772.220005:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1039b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432772.220021:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1039b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432772.220035:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1039b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432772.220414:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787432772.220420:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432772.221202:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1039b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432772.221254:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f10394 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025dc0 expref: 7 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432772.221278:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1039b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025dc0 expref: 6 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432772.221303:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a900) 00010000:00010000:3.0:1787432772.221306:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432772.221311:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154600, rc 0) 00000100:00100000:3.0:1787432772.221468:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:11069:x1874258791824000:12345-192.168.202.15@tcp:101:lsof.0 Request processed in 1608us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432772.221477:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 136 00010000:00010000:3.0:1787432772.725969:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432773.750099:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787432774.495984:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1787432774.496309:0:5889:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1787432774.496350:0:5900:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1787432774.496362:0:5900:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1787432774.776765:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432774.902532:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb6e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812806272:0@lo:400:kworker.0 00000100:00100000:1.0:1787432774.902647:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432774.902777:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432774.902786:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb6e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812806144:0@lo:400:kworker.0 00000100:00100000:2.0:1787432774.902819:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812806272 00000100:00100000:1.0:1787432774.902821:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432774.902832:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812806272 00000100:00100000:2.0:1787432774.902926:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787432774.902939:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812806272:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787432774.903060:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787432774.903137:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb6e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812805888:0@lo:400:kworker.0 00000100:00100000:3.0:1787432774.903179:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432774.903216:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812806400:0@lo:400:kworker.0 00000100:00100000:3.0:1787432774.903238:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432774.903307:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb6e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3331:1874258812806016:0@lo:400:kworker.0 00000100:00100000:1.0:1787432774.903374:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812805888 00000100:00100000:1.0:1787432774.903379:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812805888 00000100:00100000:1.0:1787432774.903411:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787432774.903417:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812805888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432774.911690:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812806144 00000100:00100000:3.0:1787432774.911714:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812806144 00000100:00100000:3.0:1787432774.911824:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812806400 00000100:00100000:3.0:1787432774.911828:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812806400 00000100:00100000:3.0:1787432774.911867:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787432774.911879:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812806144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432774.912014:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812806144:12345-0@lo:400:kworker.0 Request processed in 137us (9192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432774.912022:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787432774.912044:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787432774.912051:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812806400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432774.912265:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812806400:12345-0@lo:400:kworker.0 Request processed in 214us (9025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432774.912272:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:3.0:1787432774.912383:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432774.912427:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812806400:0@lo:400:kworker.0 00000100:00100000:3.0:1787432774.912580:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb6e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812806144:0@lo:400:kworker.0 00000100:00100000:3.0:1787432774.912653:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb6e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812806272:0@lo:400:kworker.0 00000100:00100000:2.0:1787432774.916449:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812806272:12345-0@lo:400:kworker.0 Request processed in 13494us (13783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432774.916471:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787432774.918333:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432774.918411:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812806528:0@lo:400:kworker.0 00000100:00100000:0.0:1787432774.918471:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432774.919157:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812806528 00000100:00100000:2.0:1787432774.919170:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812806528 00000100:00100000:2.0:1787432774.919265:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787432774.919277:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812806528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432774.919369:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812806528:12345-0@lo:400:kworker.0 Request processed in 94us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432774.919378:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787432774.919478:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812806528:0@lo:400:kworker.0 00000100:00080000:0.0:1787432774.919638:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432774.920032:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812806016 00000100:00100000:3.0:1787432774.920038:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812806016 00000100:00100000:3.0:1787432774.920094:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787432774.920103:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3331:x1874258812806016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432774.920159:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3331:x1874258812806016:12345-0@lo:400:kworker.0 Request processed in 58us (1838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432774.920165:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787432774.920792:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812805888:12345-0@lo:400:kworker.0 Request processed in 17369us (17606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432774.920804:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787432774.921035:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb6e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3331:1874258812806016:0@lo:400:kworker.0 00000100:00100000:3.0:1787432774.921567:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb6e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812805888:0@lo:400:kworker.0 00000100:00100000:1.0:1787432775.415204:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812806784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432775.415204:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba866a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812806656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432775.415301:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432775.415510:0:9985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812806784 00000100:00100000:3.0:1787432775.415532:0:9985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812806784 00000100:00100000:3.0:1787432775.415622:0:9985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787432775.415637:0:9985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812806784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787432775.415742:0:9985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787432775.415813:0:9985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812806784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 180us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432775.415833:0:9985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787432775.416173:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432775.416338:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812806784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432775.416418:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812806656 00000100:00100000:1.0:1787432775.416426:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812806656 00000100:00100000:1.0:1787432775.416469:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787432775.416478:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812806656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432775.416504:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432775.416567:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812806656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432775.416574:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787432775.416713:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba866a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812806656:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787432775.798159:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432776.634323:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432776.634384:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432776.634423:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432776.634457:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432776.634488:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432776.634534:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791824512 00000100:00100000:0.0:1787432776.634549:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791824512 00000100:00100000:0.0:1787432776.634632:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791824384 00000100:00100000:0.0:1787432776.634636:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791824384 00000100:00100000:0.0:1787432776.634687:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 87 00000100:00100000:0.0:1787432776.634794:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791824512:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432776.634896:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791824512:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 199us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432776.634906:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 87 00000100:00100000:0.0:1787432776.634930:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 88 00000100:00100000:0.0:1787432776.634938:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791824384:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432776.634964:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791824384:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 29us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432776.634970:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 88 00000100:00100000:0.0:1787432776.634996:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791824256 00000100:00100000:0.0:1787432776.635000:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791824256 00000100:00100000:0.0:1787432776.635030:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791824640 00000100:00100000:0.0:1787432776.635033:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791824640 00000100:00100000:0.0:1787432776.635056:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 157 00000100:00100000:0.0:1787432776.635063:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+13:2375:x1874258791824256:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432776.635218:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 158 00000100:00100000:1.0:1787432776.635232:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:2375:x1874258791824640:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432776.635269:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:2375:x1874258791824640:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 42us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432776.635277:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 158 00000100:00100000:0.0:1787432776.636252:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+13:2375:x1874258791824256:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 1185us (1941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432776.636274:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 157 00000100:00080000:0.0:1787432776.636310:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787432776.636318:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787432776.636321:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432776.639323:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791824128 00000100:00100000:2.0:1787432776.639347:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791824128 00000100:00100000:2.0:1787432776.639490:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 296 00000100:00100000:2.0:1787432776.639504:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2375:x1874258791824128:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787432776.639623:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2375:x1874258791824128:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 121us (5197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432776.639642:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 296 00010000:00010000:1.0:1787432776.821816:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787432777.021362:0:12354:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 17:06:15 (1787432775) 00010000:00010000:3.0:1787432777.847861:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432778.423306:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432778.423422:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791824896 00000100:00100000:2.0:1787432778.423436:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791824896 00000100:00100000:2.0:1787432778.423550:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 137 00000100:00100000:2.0:1787432778.423564:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+13:11334:x1874258791824896:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787432778.423593:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432778.423632:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f103a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025dc7 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.423791:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f103a9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.423811:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f103a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.423828:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f103a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.423867:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f103b0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.423876:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f103b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.423884:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f103b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.424449:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f103b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.424461:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f103b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.424470:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f103b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432778.424480:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787432778.424779:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f103a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.424790:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f103a9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.424798:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f103a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.424805:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432778.424811:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f103a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.424833:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f103a9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.424849:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff935ba2a69500) 00010000:00010000:2.0:1787432778.424852:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432778.424858:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f103a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.424864:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f103a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.424881:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f103b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.424886:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f103b0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.424892:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f103b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.424896:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432778.424899:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f103b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.424904:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f103b0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.424911:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff935b952e8e00) 00010000:00010000:2.0:1787432778.424913:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432778.424916:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f103b0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.424929:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f103b0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.425482:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f103a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025dc7 expref: 16 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.425502:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f103b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025dc7 expref: 15 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432778.425510:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff935b8304a100) 00010000:00010000:2.0:1787432778.425513:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432778.425516:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e600, rc 0) 00000100:00100000:2.0:1787432778.425612:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+15:11334:x1874258791824896:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 2050us (2321us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787432778.425623:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 137 00000100:00080000:0.0:1787432778.426224:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432778.441911:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432778.442156:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791825024 00000100:00100000:0.0:1787432778.442172:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791825024 00000100:00100000:0.0:1787432778.442259:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 138 00000100:00100000:0.0:1787432778.442274:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+15:11334:x1874258791825024:12345-192.168.202.15@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787432778.442433:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+15:11334:x1874258791825024:12345-192.168.202.15@tcp:59:lhsmtool_posix.0 Request processed in 161us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432778.442443:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 138 00000100:00100000:0.0:1787432778.447102:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432778.455393:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791825152 00000100:00100000:1.0:1787432778.455416:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791825152 00000100:00100000:1.0:1787432778.455526:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:1.0:1787432778.455540:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+15:2376:x1874258791825152:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432778.455565:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432778.455603:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f103b7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025dc7 expref: 15 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432778.455635:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff935b8304a100) 00010000:00010000:1.0:1787432778.455641:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432778.455977:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+14:2376:x1874258791825152:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 437us (8888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432778.456013:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000040:00080000:3.0:1787432778.486170:0:11725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787432778.486186:0:11725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787432778.492029:0:11725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1787432778.492052:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787432778.871792:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787432779.605869:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:1.0:1787432779.893919:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432780.025216:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3331:1874258812807040:0@lo:400:kworker.0 00000100:00100000:2.0:1787432780.025317:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432780.025394:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812807552:0@lo:400:kworker.0 00000100:00100000:2.0:1787432780.025425:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432780.025461:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787432780.025467:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812806912:0@lo:400:kworker.0 00000100:00100000:2.0:1787432780.026236:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432780.027968:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812807424:0@lo:400:kworker.0 00000100:00100000:2.0:1787432780.028052:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432780.028114:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3332:1874258812807168:0@lo:400:kworker.0 00000100:00100000:2.0:1787432780.028143:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432780.028174:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787432780.028181:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812807296:0@lo:400:kworker.0 00000100:00100000:2.0:1787432780.028212:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432780.028363:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812807040 00000100:00100000:2.0:1787432780.028373:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812807040 00000100:00100000:2.0:1787432780.028430:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812807424 00000100:00100000:2.0:1787432780.028434:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812807424 00000100:00100000:2.0:1787432780.028465:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812807168 00000100:00100000:2.0:1787432780.028468:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812807168 00000100:00100000:2.0:1787432780.028487:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787432780.028497:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3331:x1874258812807040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432780.028563:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3331:x1874258812807040:12345-0@lo:400:kworker.0 Request processed in 67us (3247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432780.028572:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787432780.028591:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787432780.028597:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812807424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432780.028626:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812807424:12345-0@lo:400:kworker.0 Request processed in 30us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432780.028632:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787432780.028643:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787432780.028649:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1874258812807168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432780.028740:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1874258812807168:12345-0@lo:400:kworker.0 Request processed in 91us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432780.029235:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787432780.029268:0:12109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812807552 00000100:00100000:2.0:1787432780.029273:0:12109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812807552 00000100:00100000:2.0:1787432780.029358:0:12109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812807296 00000100:00100000:2.0:1787432780.029362:0:12109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812807296 00000100:00100000:0.0:1787432780.030161:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812806912 00000100:00100000:0.0:1787432780.030171:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812806912 00000100:00100000:0.0:1787432780.030217:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787432780.030229:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3331:x1874258812806912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432780.030317:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3331:x1874258812806912:12345-0@lo:400:kworker.0 Request processed in 89us (4082us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432780.030325:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1787432780.040102:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787432780.040343:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812807552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432780.040464:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812807552:12345-0@lo:400:kworker.0 Request processed in 343us (15036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432780.040472:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787432780.040500:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787432780.040507:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812807296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432780.040539:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812807296:12345-0@lo:400:kworker.0 Request processed in 33us (12327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432780.040545:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1787432780.043731:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787432780.043747:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432780.043751:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432780.044838:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812806912:0@lo:400:kworker.0 00000100:00100000:0.0:1787432780.044869:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812807424:0@lo:400:kworker.0 00000100:00100000:0.0:1787432780.044883:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3331:1874258812807040:0@lo:400:kworker.0 00000100:00100000:0.0:1787432780.044897:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812807552:0@lo:400:kworker.0 00000100:00100000:3.0:1787432780.045131:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812807296:0@lo:400:kworker.0 00000100:00100000:3.0:1787432780.045150:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3332:1874258812807168:0@lo:400:kworker.0 00000100:00100000:1.0:1787432780.536476:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432780.536532:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812807680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432780.536783:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432780.537256:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812807680 00000100:00100000:2.0:1787432780.537269:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812807680 00000100:00100000:2.0:1787432780.537358:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787432780.537375:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812807680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432780.537426:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432780.537515:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812807680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432780.537584:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787432780.538108:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432780.538134:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba864000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812807808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432780.538192:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432780.538889:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812807680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432780.539273:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812807808 00000100:00100000:2.0:1787432780.539282:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812807808 00000100:00100000:2.0:1787432780.539496:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787432780.539514:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812807808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432780.539561:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432780.540623:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812807808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1102us (2418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432780.540827:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba864000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812807808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432780.541208:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787432780.892044:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432780.892157:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791825280 00000100:00100000:0.0:1787432780.892172:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791825280 00000100:00100000:0.0:1787432780.892280:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 139 00000100:00100000:0.0:1787432780.892295:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+13:11376:x1874258791825280:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787432780.892323:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432780.892362:0:6929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f103c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025dce expref: -99 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787432780.892390:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787432780.892462:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.892481:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.892510:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.892537:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f103d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.892544:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f103d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.892552:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f103d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.892988:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.892998:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.893005:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.893012:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cfe00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432780.893017:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.893025:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.893040:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a900) 00010000:00010000:0.0:1787432780.893043:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432780.893048:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.893055:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.893066:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f103d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.893071:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f103d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.893075:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f103d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.893087:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1ce400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432780.893090:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f103d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.893096:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f103d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.893105:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff935b9838f600) 00010000:00010000:0.0:1787432780.893107:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432780.893110:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f103d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.893116:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f103d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.893159:0:6929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f103c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025dce expref: 14 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.893172:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a900) 00010000:00010000:0.0:1787432780.893175:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432780.893179:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f103c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025dce expref: 14 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.893189:0:6929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1ce200, rc 0) 00000100:00100000:0.0:1787432780.893277:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+13:11376:x1874258791825280:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 985us (1248us total) trans 0 rc 301/301 00000100:00100000:0.0:1787432780.893287:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 139 00000100:00100000:3.0:1787432780.910018:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432780.910117:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791825536 00000100:00100000:0.0:1787432780.910147:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791825536 00000100:00100000:0.0:1787432780.910244:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 140 00000100:00100000:0.0:1787432780.910256:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+13:11376:x1874258791825536:12345-192.168.202.15@tcp:36:lfs.0 00010000:00010000:0.0:1787432780.910350:0:5869:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432780.910396:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2167200/0xbcb9e331c3f0fd43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c07 expref: 13 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.910423:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a900) 00010000:00010000:0.0:1787432780.910430:0:5869:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787432780.910861:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f103da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.910882:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1039b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025dc0 expref: 5 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.910893:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f103da lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.910940:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1039b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025dc0 expref: 5 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.910957:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1039b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025dc0 expref: 5 pid: 5867 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432780.910975:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5869:1874258812807936:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787432780.911104:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9a6dff00 going to sleep for 11 seconds 00010000:00010000:3.0:1787432780.918069:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432780.922261:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5869:1874258812807936:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787432780.922311:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f103da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432780.923827:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432780.926634:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791825664 00000100:00100000:0.0:1787432780.926714:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791825664 00010000:00010000:0.0:1787432780.926854:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1039b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025dc0 expref: 6 pid: 5867 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432780.926912:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:0.0:1787432780.926926:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba864e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:2376:x1874258791825664:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432780.926947:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432780.926956:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1039b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025dc0 expref: 6 pid: 5867 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.926972:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1039b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025dc0 expref: 6 pid: 5867 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.927001:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1039b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025dc0 expref: 6 pid: 5867 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.927021:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a900) 00010000:00010000:0.0:1787432780.927027:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f103da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.927038:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f103da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.927045:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f103da lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.927080:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432780.927161:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba864e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2376:x1874258791825664:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 238us (3345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432780.927170:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 61 00010000:00010000:0.0:1787432780.927359:0:5869:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f103da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.927385:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f103da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.927415:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103e1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.927427:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.927436:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432780.928960:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787432780.928979:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f103da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.928989:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f103da lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.928997:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f103da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.929004:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1ce200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432780.929010:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f103da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.929019:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f103da lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.929037:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a900) 00010000:00010000:0.0:1787432780.929041:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432780.929055:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f103da lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432780.929062:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f103da lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787432780.929084:0:5869:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc86e0c0 reply state 00000000a3833fe1 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432780.929094:0:5869:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787432780.929211:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+14:11376:x1874258791825536:12345-192.168.202.15@tcp:36:lfs.0 Request processed in 18953us (19205us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787432780.929221:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 140 00000100:00080000:3.0:1787432780.932836:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787432780.935818:0:3317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432780.935854:0:3317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103e1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432780.935864:0:3317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103e1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432780.935871:0:3317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cfe00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432780.935877:0:3317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103e1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432780.935887:0:3317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103e1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432780.935909:0:3317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff935b9838f600) 00010000:00010000:2.0:1787432780.935913:0:3317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432780.935919:0:3317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103e1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432780.935927:0:3317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f103e1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432781.044016:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432781.044124:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791825792 00000100:00100000:3.0:1787432781.044140:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791825792 00000100:00100000:3.0:1787432781.044234:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 141 00000100:00100000:3.0:1787432781.044259:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+13:11384:x1874258791825792:12345-192.168.202.15@tcp:101:lctl.0 00010000:00010000:3.0:1787432781.044291:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432781.044322:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f103e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025dd5 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.044420:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f103ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.044438:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f103ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.044452:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f103ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432781.044530:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787432781.044534:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432781.044558:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f103ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.044586:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f103e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025dd5 expref: 15 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.044618:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f103ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025dd5 expref: 14 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.044629:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a200) 00010000:00010000:3.0:1787432781.044632:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432781.044635:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155c00, rc 0) 00000100:00100000:3.0:1787432781.049115:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+14:11384:x1874258791825792:12345-192.168.202.15@tcp:101:lctl.0 Request processed in 4838us (5092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432781.049156:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 141 00000100:00100000:1.0:1787432781.120273:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432781.120443:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791825920 00000100:00100000:2.0:1787432781.120458:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791825920 00000100:00100000:2.0:1787432781.120559:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 142 00000100:00100000:2.0:1787432781.120573:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+14:11390:x1874258791825920:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787432781.120603:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432781.120632:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f103f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025ddc expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.120934:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f103fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.120954:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f103fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.120967:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f103fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.120985:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10404 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.120992:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.120999:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.121145:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1040b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.121154:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1040b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.121161:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1040b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432781.121201:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787432781.121206:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787432781.121238:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1040b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.121264:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f103fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.121270:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f103fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.121277:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f103fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.121283:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fa00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432781.121288:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f103fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.121295:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f103fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.121311:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a200) 00010000:00010000:2.0:1787432781.121314:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432781.121319:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f103fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.121325:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f103fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.121818:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.121828:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10404 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.121834:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10404 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.121848:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432781.121851:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10404 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.121858:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10404 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.121868:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff935b952e8e00) 00010000:00010000:2.0:1787432781.121870:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432781.121873:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10404 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.121879:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10404 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.121924:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f103f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ddc expref: 16 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.121940:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1040b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ddc expref: 15 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.121948:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:2.0:1787432781.121951:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787432781.121953:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f800, rc 0) 00000100:00100000:2.0:1787432781.122047:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+15:11390:x1874258791825920:12345-192.168.202.15@tcp:101:bash.0 Request processed in 1477us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432781.122057:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 142 00000100:00100000:1.0:1787432781.128237:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432781.128322:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791826176 00000100:00100000:0.0:1787432781.128350:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791826176 00000100:00100000:0.0:1787432781.128502:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 143 00000100:00100000:0.0:1787432781.128518:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+15:11390:x1874258791826176:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787432781.128551:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432781.128580:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f10412 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025de3 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.128837:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f10419 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.128856:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f10419 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.128871:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f10419 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.128890:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f10420 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.128928:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f10420 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.128936:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f10420 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787432781.129588:0:5869:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787432781.129852:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf400/0xbcb9e331c3f10427 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.129863:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf400/0xbcb9e331c3f10427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.129872:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf400/0xbcb9e331c3f10427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.129913:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f10419 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.129921:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f10419 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.129928:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f10419 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.129935:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cf800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432781.129940:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f10419 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.129948:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f10419 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.129975:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:0.0:1787432781.129979:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432781.129985:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f10419 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.129991:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf800/0xbcb9e331c3f10419 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787432781.130006:0:5869:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd9cb32e reply state 0000000033b1a4f7 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f10420 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432781.130016:0:5869:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787432781.130057:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce200/0xbcb9e331c3f10412 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025de3 expref: 18 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.130072:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf400/0xbcb9e331c3f10427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025de3 expref: 17 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.130080:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838fb00) 00010000:00010000:0.0:1787432781.130083:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432781.130085:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cf400, rc 0) 00000100:00100000:0.0:1787432781.130172:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+18:11390:x1874258791826176:12345-192.168.202.15@tcp:101:bash.0 Request processed in 1657us (1950us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1787432781.130181:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 143 00010000:00010000:2.0:1787432781.134051:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f10420 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.134094:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f10420 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.134102:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f10420 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.134109:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cfe00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432781.134115:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f10420 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.134124:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f10420 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.134148:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff935b9838ff00) 00010000:00010000:2.0:1787432781.134152:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432781.134158:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f10420 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.134165:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f10420 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432781.138166:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432781.138265:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791826304 00000100:00100000:2.0:1787432781.138279:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791826304 00000100:00100000:2.0:1787432781.138394:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:2.0:1787432781.138408:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791826304:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787432781.138433:0:6726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432781.138464:0:6726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a633547/0xbcb9e331c3f10435 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025dea expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787432781.138518:0:6726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787432781.138544:0:6726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787432781.138550:0:6726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432781.138563:0:6726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a633547/0xbcb9e331c3f10435 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025dea expref: 6 pid: 6726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.138595:0:6726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a633547/0xbcb9e331c3f10435 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025dea expref: 6 pid: 6726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.138614:0:6726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e000, rc 0) 00000100:00100000:2.0:1787432781.138739:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791826304:12345-192.168.202.15@tcp:101:bash.0 Request processed in 334us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432781.138748:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00080000:3.0:1787432781.138928:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432781.141888:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432781.142007:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791826432 00000100:00100000:0.0:1787432781.142020:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791826432 00000100:00100000:0.0:1787432781.142097:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:0.0:1787432781.142109:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:11390:x1874258791826432:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787432781.142150:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432781.142174:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000728ebbcb/0xbcb9e331c3f1043c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025df1 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.142216:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a633547/0xbcb9e331c3f10435 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025dea expref: 7 pid: 6726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.142226:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432781.142231:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432781.142236:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000728ebbcb/0xbcb9e331c3f1043c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025df1 expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.142283:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a633547/0xbcb9e331c3f10435 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025dea expref: 7 pid: 6726 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.142298:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a633547/0xbcb9e331c3f10435 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025dea expref: 7 pid: 6726 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432781.142315:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8446:1874258812808064:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787432781.142452:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb7d8f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787432781.145890:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432781.146156:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791826560 00000100:00100000:2.0:1787432781.146170:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791826560 00010000:00010000:2.0:1787432781.146222:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a633547/0xbcb9e331c3f10435 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025dea expref: 8 pid: 6726 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432781.146278:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:2.0:1787432781.146292:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+8:2376:x1874258791826560:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432781.146318:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432781.146734:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a633547/0xbcb9e331c3f10435 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025dea expref: 8 pid: 6726 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.146775:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a633547/0xbcb9e331c3f10435 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025dea expref: 8 pid: 6726 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.146810:0:5851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432781.146815:0:5851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432781.146824:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000728ebbcb/0xbcb9e331c3f1043c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025df1 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.146836:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000728ebbcb/0xbcb9e331c3f1043c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025df1 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.146890:0:5851:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000728ebbcb/0xbcb9e331c3f1043c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025df1 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432781.146909:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5851:1874258812808192:192.168.202.15@tcp:105: 00000100:00100000:2.0:1787432781.147022:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba051d180 going to sleep for 11 seconds 00010000:00010000:0.0:1787432781.147539:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a633547/0xbcb9e331c3f10435 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025dea expref: 8 pid: 6726 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432781.147560:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8446:1874258812808064:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787432781.147597:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000728ebbcb/0xbcb9e331c3f1043c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025df1 expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.147621:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1ce200, rc 0) 00000100:00100000:0.0:1787432781.147741:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+7:11390:x1874258791826432:12345-192.168.202.15@tcp:101:bash.0 Request processed in 5632us (5865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432781.147751:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:1.0:1787432781.152250:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432781.152458:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791826816 00000100:00100000:3.0:1787432781.152470:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791826816 00000100:00100000:2.0:1787432781.152887:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5851:1874258812808192:192.168.202.15@tcp:105: 00010000:00010000:2.0:1787432781.152917:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432781.152996:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+6:2376:x1874258791826560:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 6705us (7122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432781.153007:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:3.0:1787432781.153113:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:3.0:1787432781.153125:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+17:11390:x1874258791826816:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:3.0:1787432781.155067:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+18:11390:x1874258791826816:12345-192.168.202.15@tcp:35:bash.0 Request processed in 1931us (2816us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787432781.155081:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:2.0:1787432781.211442:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432781.211570:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791827072 00000100:00100000:3.0:1787432781.211582:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791827072 00000100:00100000:3.0:1787432781.211780:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 144 00000100:00100000:3.0:1787432781.211792:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+18:11400:x1874258791827072:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432781.211824:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432781.211847:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f10443 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025df8 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432781.211984:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787432781.212110:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f10443 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025df8 expref: 20 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.212125:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a200) 00010000:00010000:3.0:1787432781.212127:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432781.212131:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f10443 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025df8 expref: 20 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.212162:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155200, rc 0) 00000100:00100000:3.0:1787432781.212231:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+19:11400:x1874258791827072:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 440us (804us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1787432781.212239:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 144 00000100:00100000:2.0:1787432781.214483:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432781.214563:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791827328 00000100:00100000:0.0:1787432781.214574:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791827328 00000100:00100000:0.0:1787432781.214966:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:0.0:1787432781.214979:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+19:11400:x1874258791827328:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:0.0:1787432781.215269:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+20:11400:x1874258791827328:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 292us (795us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787432781.215366:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:1.0:1787432781.242540:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432781.242613:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432781.242916:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791827456 00000100:00100000:0.0:1787432781.242932:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791827456 00002000:00100000:0.0:1787432781.243011:0:6729:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff935a84b44380 x1874258791827456/t0(0) o4->ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp:492/0 lens 504/0 e 0 to 0 dl 1787432792 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787432781.243027:0:6729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935a84b44380 with x1874258791827456 ext(0->12) 00002000:00010000:0.0:1787432781.243034:0:6729:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff935a84b44380 00000100:00100000:0.0:1787432781.243080:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:0.0:1787432781.243093:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791827456:12345-192.168.202.15@tcp:4:bash.0 00000100:00100000:3.0:1787432781.244195:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791827584 00000100:00100000:3.0:1787432781.244209:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791827584 00000100:00100000:3.0:1787432781.244273:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:3.0:1787432781.244284:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8b542c-0113-490f-a721-62606ee0807f+9:2375:x1874258791827584:12345-192.168.202.15@tcp:16:kworker.0 00000100:00100000:0.0:1787432781.245516:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ee8b542c-0113-490f-a721-62606ee0807f+9:2375:x1874258791827456:12345-192.168.202.15@tcp:4:bash.0 Request processed in 2413us (2990us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787432781.245531:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00002000:00100000:0.0:1787432781.245545:0:6729:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff935a84b44380 x1874258791827456/t4294967305(0) o4->ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp:492/0 lens 504/448 e 0 to 0 dl 1787432792 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787432781.245575:0:6729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935a84b44380 with x1874258791827456 ext(0->12) 00002000:00010000:0.0:1787432781.245583:0:6729:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff935a84b44380 00000100:00100000:0.0:1787432781.284875:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432781.285032:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791827712 00000100:00100000:3.0:1787432781.285048:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791827712 00000100:00100000:3.0:1787432781.285124:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 145 00000100:00100000:3.0:1787432781.285137:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+20:11406:x1874258791827712:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432781.285173:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432781.285202:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f10451 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025dff expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.285301:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10458 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.285318:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.285329:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432781.286100:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787432781.286104:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432781.286159:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.286201:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f10451 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025dff expref: 22 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.286225:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10458 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025dff expref: 21 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.286235:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:3.0:1787432781.286239:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432781.286244:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154000, rc 0) 00000100:00100000:3.0:1787432781.286345:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+21:11406:x1874258791827712:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1210us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432781.286355:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 145 00000100:00100000:2.0:1787432781.291759:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432781.292038:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791827968 00000100:00100000:3.0:1787432781.292053:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791827968 00000100:00100000:3.0:1787432781.292132:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 146 00000100:00100000:3.0:1787432781.292144:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+21:11406:x1874258791827968:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432781.292172:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432781.292199:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f1045f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e06 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.292332:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10466 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.292350:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.292362:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432781.292384:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787432781.293749:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f1045f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e06 expref: 24 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.293783:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10466 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e06 expref: 23 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.293793:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838fb00) 00010000:00010000:3.0:1787432781.293797:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432781.293802:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154a00, rc 0) 00000100:00100000:3.0:1787432781.293889:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+23:11406:x1874258791827968:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1746us (2149us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1787432781.293899:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 146 00000100:00100000:1.0:1787432781.304141:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432781.304200:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432781.304476:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791828352 00000100:00100000:0.0:1787432781.304491:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791828352 00000100:00100000:3.0:1787432781.304533:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791828096 00000100:00100000:3.0:1787432781.304538:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791828096 00000100:00100000:0.0:1787432781.304904:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 147 00000100:00100000:2.0:1787432781.310275:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8b542c-0113-490f-a721-62606ee0807f+8:2375:x1874258791827584:12345-192.168.202.15@tcp:16:kworker.0 Request processed in 65976us (67644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432781.310291:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:0.0:1787432781.310425:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+24:11406:x1874258791828352:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787432781.312112:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432781.312149:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f10474 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e0d expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.312291:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f1047b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.312311:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f1047b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.312343:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f1047b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432781.312360:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787432781.312525:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f10474 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e0d expref: 27 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.312548:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f1047b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e0d expref: 26 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.312558:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838fb00) 00010000:00010000:1.0:1787432781.312561:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787432781.312566:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e6600, rc 0) 00000100:00100000:1.0:1787432781.312652:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+26:11406:x1874258791828352:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 7737us (8450us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1787432781.312726:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 147 00000001:00080000:2.0:1787432781.313871:0:6749:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:3.0:1787432781.317144:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:3.0:1787432781.317160:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+25:2375:x1874258791828096:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432781.317180:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432781.317208:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10466 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e06 expref: 25 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.317228:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838fb00) 00010000:00010000:3.0:1787432781.317231:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432781.317462:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+24:2375:x1874258791828096:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 305us (13336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432781.317469:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:2.0:1787432781.317617:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432781.317846:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791828480 00000100:00100000:0.0:1787432781.317856:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791828480 00000100:00100000:0.0:1787432781.317894:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:0.0:1787432781.317900:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791828480:12345-192.168.202.15@tcp:1:lfs.0 00010000:00010000:0.0:1787432781.317950:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f10489 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.317969:0:6725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000728ebbcb/0xbcb9e331c3f1043c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025df1 expref: 6 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.317976:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432781.317981:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432781.317984:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f10489 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.318018:0:6725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000728ebbcb/0xbcb9e331c3f1043c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x93816182a025df1 expref: 6 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.318041:0:6725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000728ebbcb/0xbcb9e331c3f1043c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025df1 expref: 6 pid: 8446 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432781.318054:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6725:1874258812808320:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787432781.318147:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b84b28b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432781.321071:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432781.321202:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791828608 00000100:00100000:1.0:1787432781.321215:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791828608 00010000:00010000:1.0:1787432781.321272:0:8489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000728ebbcb/0xbcb9e331c3f1043c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025df1 expref: 7 pid: 8446 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432781.321430:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:1.0:1787432781.321444:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb992b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+7:2376:x1874258791828608:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432781.321467:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787432781.321495:0:8489:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787432781.321499:0:8489:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787432781 00002000:00010000:1.0:1787432781.321532:0:8489:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787432781 00002000:00010000:1.0:1787432781.321534:0:8489:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1787432781.321542:0:8489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000728ebbcb/0xbcb9e331c3f1043c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025df1 expref: 7 pid: 8446 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.321558:0:8489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000728ebbcb/0xbcb9e331c3f1043c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025df1 expref: 7 pid: 8446 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.321590:0:8489:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787432781.321595:0:8489:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787432781.321602:0:8489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f10489 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.321615:0:8489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f10489 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.321643:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432781.321759:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb992b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+7:2376:x1874258791828608:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 319us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432781.321769:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 63 00010000:00010000:0.0:1787432781.323119:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000728ebbcb/0xbcb9e331c3f1043c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025df1 expref: 6 pid: 8446 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432781.323138:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6725:1874258812808320:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787432781.323164:0:6725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f10489 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.323173:0:6725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f10489 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.323178:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f10489 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.323212:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f10489 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.323217:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f10489 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.323244:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f10489 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.323249:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cf000 already unused, calling callback (ffffffffc1752230) 00010000:00010000:0.0:1787432781.323252:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f10489 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.323258:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f10489 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.323274:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f10489 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.323279:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e43b28/0xbcb9e331c3f10489 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432781.323373:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791828480:12345-192.168.202.15@tcp:1:lfs.0 Request processed in 5471us (5755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432781.323382:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:2.0:1787432781.332076:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432781.332208:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791828864 00000100:00100000:3.0:1787432781.332223:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791828864 00000100:00100000:3.0:1787432781.332297:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:3.0:1787432781.332307:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8355d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+24:11406:x1874258791828864:12345-192.168.202.15@tcp:35:lfs.0 00000004:00010000:3.0:1787432781.332407:0:5870:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f1047b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e0d expref: 24 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787432781.332804:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1787432781.332836:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1787432781.334169:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1787432781.334271:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10490 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.334296:0:5870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf400/0xbcb9e331c3f10427 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025de3 expref: 28 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.334306:0:5870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10490 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.334426:0:5870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf400/0xbcb9e331c3f10427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025de3 expref: 28 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.334447:0:5870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf400/0xbcb9e331c3f10427 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025de3 expref: 28 pid: 5869 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432781.334465:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9929c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5870:1874258812808448:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432781.334891:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba051d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432781.338225:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432781.338611:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791828992 00000100:00100000:0.0:1787432781.338626:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791828992 00010000:00010000:0.0:1787432781.338740:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf400/0xbcb9e331c3f10427 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025de3 expref: 29 pid: 5869 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432781.338790:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 64 00000100:00100000:0.0:1787432781.338824:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b909b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+29:2375:x1874258791828992:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432781.338848:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432781.338858:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf400/0xbcb9e331c3f10427 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025de3 expref: 29 pid: 5869 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.338873:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf400/0xbcb9e331c3f10427 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025de3 expref: 29 pid: 5869 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.338906:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838fb00) 00010000:00010000:0.0:1787432781.338926:0:5853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10490 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.338929:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf400/0xbcb9e331c3f10427 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025de3 expref: 29 pid: 5869 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.338939:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10490 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.338947:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10490 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432781.338951:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9929c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5870:1874258812808448:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787432781.338972:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432781.338987:0:5870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10490 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.338997:0:5870:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10490 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.339002:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10490 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432781.339044:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b909b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+28:2375:x1874258791828992:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 222us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432781.339052:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 64 00000001:00080000:2.0:1787432781.339192:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787432781.339784:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1787432781.339944:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9929c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5870:1874258812808576:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787432781.340014:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432781.340058:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba40a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432781.340209:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812808576 00000100:00100000:3.0:1787432781.340219:0:5873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812808576 00000100:00100000:3.0:1787432781.340272:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787432781.340283:0:5873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb992b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5870:x1874258812808576:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787432781.340442:0:5873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb992b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5870:x1874258812808576:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 159us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432781.340450:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787432781.341845:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9929c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5870:1874258812808576:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787432781.342502:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1787432781.342622:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a94700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5870:1874258812808704:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787432781.342782:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432781.342856:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812808704 00000100:00100000:2.0:1787432781.342864:0:5873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812808704 00000100:00100000:2.0:1787432781.342937:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787432781.342948:0:5873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5870:x1874258812808704:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787432781.343248:0:5873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5870:x1874258812808704:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 300us (465us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787432781.343256:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787432781.343324:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9087de40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432781.343386:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a94700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5870:1874258812808704:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787432781.343464:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1787432781.343532:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10490 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.343545:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10490 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.343571:0:5870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10490 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.343578:0:5870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432781.343585:0:5870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10490 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.343607:0:5870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10490 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.343629:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838fb00) 00010000:00010000:1.0:1787432781.343633:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787432781.343639:0:5870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10490 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.343646:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10490 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787432781.343938:0:5870:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787432781.344084:0:5870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1787432781.344101:0:5870:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 416009442502ns, next at 417009438838ns, rc = 0 00000001:00080000:1.0:1787432781.344110:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1787432781.344148:0:5870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838fb00) 00010000:00010000:1.0:1787432781.344152:0:5870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787432781.344163:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f1047b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e0d expref: 32 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432781.344319:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8355d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+31:11406:x1874258791828864:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 12012us (12254us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1787432781.344342:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 38 00000020:00080000:1.0:1787432781.344347:0:5870:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787432781.349160:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432781.349285:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791829120 00000100:00100000:3.0:1787432781.349299:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791829120 00000100:00100000:3.0:1787432781.349412:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 148 00000100:00100000:3.0:1787432781.349426:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+31:11406:x1874258791829120:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432781.349462:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432781.349494:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10497 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e14 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.349602:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10497 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e14 expref: 32 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.349621:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10497 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e14 expref: 32 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.349734:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:3.0:1787432781.349740:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787432781.349745:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155600, rc 0) 00000100:00100000:3.0:1787432781.349821:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+32:11406:x1874258791829120:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 399us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432781.349830:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 148 00000100:00100000:3.0:1787432781.353873:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432781.354000:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791829376 00000100:00100000:2.0:1787432781.354014:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791829376 00000100:00100000:2.0:1787432781.354087:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:2.0:1787432781.354101:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+32:11406:x1874258791829376:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787432781.354476:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+33:11406:x1874258791829376:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 375us (617us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1787432781.354484:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:0.0:1787432781.454896:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432781.455020:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791829632 00000100:00100000:3.0:1787432781.455036:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791829632 00000100:00100000:3.0:1787432781.455112:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 149 00000100:00100000:3.0:1787432781.455124:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+33:11416:x1874258791829632:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432781.455163:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432781.455192:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f1049e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e1b expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432781.455333:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787432781.455481:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f1049e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e1b expref: 35 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.455496:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a200) 00010000:00010000:3.0:1787432781.455499:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432781.455503:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f1049e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e1b expref: 35 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.455520:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154a00, rc 0) 00000100:00100000:3.0:1787432781.455622:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+34:11416:x1874258791829632:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 499us (739us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1787432781.455650:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 149 00000100:00100000:3.0:1787432781.460485:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432781.461934:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791829760 00000100:00100000:1.0:1787432781.461956:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791829760 00000100:00100000:1.0:1787432781.462045:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 150 00000100:00100000:1.0:1787432781.462138:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+34:11416:x1874258791829760:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:1.0:1787432781.462255:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f104ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462277:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f104ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462290:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f104ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462306:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f104b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462311:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f104b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462316:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f104b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462460:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f104ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462466:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f104ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462493:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f104ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787432781.462551:0:8110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f104ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462567:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f104ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462575:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f104ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462582:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f104ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462589:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432781.462595:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f104ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462604:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f104ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462795:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:1.0:1787432781.462798:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432781.462805:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f104ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462813:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f104ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462828:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f104b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462839:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f104b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462843:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f104b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462845:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e7c00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432781.462847:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f104b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462851:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f104b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462856:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff935ba2a69100) 00010000:00010000:1.0:1787432781.462858:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432781.462860:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f104b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462864:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7c00/0xbcb9e331c3f104b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462880:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f104ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462883:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f104ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462886:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f104ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462889:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6c00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432781.462895:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f104ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462899:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f104ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462903:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:1.0:1787432781.462905:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432781.462906:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f104ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.462909:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f104ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432781.462999:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+34:11416:x1874258791829760:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 942us (2531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432781.463006:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 150 00000100:00100000:0.0:1787432781.467162:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432781.467239:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791830016 00000100:00100000:2.0:1787432781.467254:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791830016 00000100:00100000:2.0:1787432781.467446:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00100000:2.0:1787432781.467459:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+34:11416:x1874258791830016:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787432781.468052:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+35:11416:x1874258791830016:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 591us (897us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1787432781.468062:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00100000:0.0:1787432781.509943:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432781.510071:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791830272 00000100:00100000:3.0:1787432781.510086:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791830272 00000100:00100000:3.0:1787432781.510172:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 151 00000100:00100000:3.0:1787432781.510186:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+35:11419:x1874258791830272:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432781.510224:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432781.510257:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f104c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e22 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.510375:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f104c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.510394:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f104c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.510407:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f104c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.510427:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f104cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.510434:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f104cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.510440:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f104cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.510625:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f104d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.510652:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f104d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.510923:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f104d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432781.510936:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787432781.511077:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f104c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.511086:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f104c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.511094:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f104c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.511101:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432781.511106:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f104c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.511116:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f104c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.511132:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:3.0:1787432781.511136:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432781.511142:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f104c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.511149:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f104c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.511167:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f104cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.511181:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f104cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.511187:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f104cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.511191:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432781.511194:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f104cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.511199:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f104cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.511207:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff935b8304ab00) 00010000:00010000:3.0:1787432781.511210:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432781.511212:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f104cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.511217:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f104cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.511279:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f104c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e22 expref: 38 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.511295:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f104d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e22 expref: 37 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.511302:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:3.0:1787432781.511304:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432781.511315:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154800, rc 0) 00000100:00100000:3.0:1787432781.511613:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+37:11419:x1874258791830272:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1428us (1684us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1787432781.511624:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 151 00000100:00100000:1.0:1787432781.516884:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432781.521031:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791830400 00000100:00100000:3.0:1787432781.521053:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791830400 00000100:00100000:3.0:1787432781.521182:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 152 00000100:00100000:3.0:1787432781.521194:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+37:11419:x1874258791830400:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:3.0:1787432781.521281:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f104e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.521309:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f104e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.521320:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f104e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.521352:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f104e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.521359:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f104e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.521367:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f104e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.521373:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154a00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432781.521379:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f104e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.521388:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f104e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.521419:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:3.0:1787432781.521421:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432781.521426:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f104e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.521430:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f104e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432781.521528:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+37:11419:x1874258791830400:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 336us (4660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432781.521537:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 152 00000100:00100000:0.0:1787432781.525260:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432781.525346:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791830656 00000100:00100000:3.0:1787432781.525361:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791830656 00000100:00100000:3.0:1787432781.525432:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:3.0:1787432781.525445:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+37:11419:x1874258791830656:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:3.0:1787432781.529621:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+38:11419:x1874258791830656:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 4154us (4354us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787432781.529642:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:0.0:1787432781.750990:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432781.751053:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432781.751098:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432781.751132:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791830912 00000100:00100000:0.0:1787432781.751132:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791831168 00000100:00100000:1.0:1787432781.751145:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791830912 00000100:00100000:0.0:1787432781.751145:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791831168 00000100:00100000:1.0:1787432781.751210:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 162 00000100:00100000:0.0:1787432781.751210:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 91 00000100:00100000:1.0:1787432781.751221:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+38:2376:x1874258791830912:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432781.751221:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:2376:x1874258791831168:12345-192.168.202.15@tcp:400:kworker.0 00000100:00080000:3.0:1787432781.751454:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432781.751800:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791830784 00000100:00100000:2.0:1787432781.751806:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791830784 00000100:00100000:2.0:1787432781.751862:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 298 00000100:00100000:2.0:1787432781.751869:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2375:x1874258791830784:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432781.752057:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:2376:x1874258791831168:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 836us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432781.752067:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 91 00000100:00100000:1.0:1787432781.759965:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+38:2376:x1874258791830912:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 8723us (8888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432781.759988:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 162 00000100:00100000:2.0:1787432781.765646:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2375:x1874258791830784:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 13757us (14654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432781.765691:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 298 00000100:00100000:3.0:1787432781.768250:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432781.768301:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432781.768395:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791831296 00000100:00100000:1.0:1787432781.768408:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791831296 00000100:00100000:1.0:1787432781.768488:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 163 00000100:00100000:1.0:1787432781.768501:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2375:x1874258791831296:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432781.768636:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2375:x1874258791831296:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 136us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432781.768645:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 163 00000100:00100000:2.0:1787432781.769709:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791831040 00000100:00100000:2.0:1787432781.769722:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791831040 00000100:00100000:2.0:1787432781.769779:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 92 00000100:00100000:2.0:1787432781.769789:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba864000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791831040:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787432781.769862:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba864000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791831040:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 74us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432781.769869:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 92 00000100:00100000:3.0:1787432781.779395:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432781.779490:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791831552 00000100:00100000:0.0:1787432781.779928:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791831552 00000100:00100000:0.0:1787432781.780065:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 153 00000100:00100000:0.0:1787432781.780080:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+38:11450:x1874258791831552:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:0.0:1787432781.780111:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432781.780141:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f104eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e29 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.780283:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f104f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.780302:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f104f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.780316:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f104f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432781.780371:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787432781.780563:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f104eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e29 expref: 41 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.780589:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f104f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e29 expref: 40 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.780599:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:0.0:1787432781.780602:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432781.780607:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cf200, rc 0) 00000100:00100000:0.0:1787432781.780766:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+40:11450:x1874258791831552:12345-192.168.202.15@tcp:101:cat.0 Request processed in 688us (1391us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787432781.780775:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 153 00000100:00100000:1.0:1787432781.784938:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432781.784995:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432781.785040:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791831936 00000100:00100000:1.0:1787432781.785055:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791831936 00000100:00100000:1.0:1787432781.785146:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:1.0:1787432781.785160:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+40:2376:x1874258791831936:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432781.785184:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432781.785226:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f104f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e29 expref: 40 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.785253:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:1.0:1787432781.785260:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432781.785354:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+39:2376:x1874258791831936:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 198us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432781.785364:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:3.0:1787432781.785466:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791831808 00000100:00100000:3.0:1787432781.785471:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791831808 00000100:00100000:3.0:1787432781.785529:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:3.0:1787432781.785538:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+39:11450:x1874258791831808:12345-192.168.202.15@tcp:35:cat.0 00000100:00100000:3.0:1787432781.785885:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+40:11450:x1874258791831808:12345-192.168.202.15@tcp:35:cat.0 Request processed in 347us (963us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787432781.785911:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:2.0:1787432781.868768:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432781.869031:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791832192 00000100:00100000:1.0:1787432781.869048:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791832192 00000100:00100000:1.0:1787432781.869132:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 154 00000100:00100000:1.0:1787432781.869143:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb992b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+40:11457:x1874258791832192:12345-192.168.202.15@tcp:101:dd.0 00010000:00010000:1.0:1787432781.869184:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432781.869187:0:8110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787432781.869214:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10458 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025dff expref: 40 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.869264:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:1.0:1787432781.869270:0:8110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432781.869489:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f10500 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e30 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.869608:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10507 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.869622:0:8110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f104d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e22 expref: 40 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.869630:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10507 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.869735:0:8110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f104d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e22 expref: 40 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.869752:0:8110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f104d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e22 expref: 40 pid: 5867 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432781.869767:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b98b19180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8110:1874258812808832:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787432781.869880:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb7d8fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787432781.874144:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432781.874315:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b98b19180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8110:1874258812808832:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787432781.874352:0:8110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10507 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432781.876200:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791832320 00000100:00100000:0.0:1787432781.876218:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791832320 00010000:00010000:0.0:1787432781.876279:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f104d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e22 expref: 41 pid: 5867 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432781.876400:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 65 00000100:00100000:0.0:1787432781.876412:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+41:2376:x1874258791832320:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432781.876431:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432781.876440:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f104d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e22 expref: 41 pid: 5867 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.876456:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f104d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e22 expref: 41 pid: 5867 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.876537:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f104d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e22 expref: 41 pid: 5867 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.876562:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:0.0:1787432781.876568:0:5853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10507 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.876581:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10507 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.876598:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10507 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432781.876638:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432781.876755:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+40:2376:x1874258791832320:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 343us (2625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432781.876763:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 65 00010000:00010000:2.0:1787432781.877934:0:8110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10507 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.877952:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10507 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432781.877998:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787432781.878219:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f10500 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e30 expref: 41 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.878249:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10507 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e30 expref: 40 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432781.878260:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:2.0:1787432781.878263:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787432781.878266:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e7800, rc 0) 00000100:00100000:2.0:1787432781.878484:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb992b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+40:11457:x1874258791832192:12345-192.168.202.15@tcp:101:dd.0 Request processed in 9339us (9730us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787432781.878495:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 154 00000100:00100000:3.0:1787432781.883176:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432781.883355:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791832576 00000100:00100000:1.0:1787432781.883388:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791832576 00000100:00100000:1.0:1787432781.883465:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 155 00000100:00100000:1.0:1787432781.883477:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+40:11457:x1874258791832576:12345-192.168.202.15@tcp:36:dd.0 00010000:00010000:1.0:1787432781.884915:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7400/0xbcb9e331c3f10515 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.884944:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7400/0xbcb9e331c3f10515 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.884959:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7400/0xbcb9e331c3f10515 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787432781.885023:0:5868:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1787432781.885054:0:5868:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e1c4c0b reply state 0000000092c7d0d2 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7400/0xbcb9e331c3f10515 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432781.885065:0:5868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787432781.885263:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+43:11457:x1874258791832576:12345-192.168.202.15@tcp:36:dd.0 Request processed in 1783us (2098us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1787432781.885274:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 155 00000020:00080000:1.0:1787432781.885281:0:5868:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787432781.892210:0:3317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7400/0xbcb9e331c3f10515 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.892236:0:3317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7400/0xbcb9e331c3f10515 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.892245:0:3317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7400/0xbcb9e331c3f10515 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.892252:0:3317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e7400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432781.892257:0:3317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7400/0xbcb9e331c3f10515 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.892289:0:3317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7400/0xbcb9e331c3f10515 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.892313:0:3317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:1.0:1787432781.892317:0:3317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432781.892323:0:3317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7400/0xbcb9e331c3f10515 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432781.892343:0:3317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7400/0xbcb9e331c3f10515 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432781.942517:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432782.161079:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432782.162832:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791832704 00000100:00100000:0.0:1787432782.162852:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791832704 00000100:00100000:1.0:1787432782.163090:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 156 00000100:00100000:1.0:1787432782.163107:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+42:11471:x1874258791832704:12345-192.168.202.15@tcp:101:stat.0 00010000:00010000:1.0:1787432782.163142:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432782.163167:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7400/0xbcb9e331c3f1051c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e37 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.163256:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f10523 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.163274:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f10523 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.163288:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f10523 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.163304:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f1052a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.163311:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f1052a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.163350:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f1052a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.163480:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.163492:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10507 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e30 expref: 43 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.163516:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10531 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.163562:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10507 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e30 expref: 43 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.163578:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10507 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e30 expref: 43 pid: 8110 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787432782.163801:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432782.167346:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b98b19180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5869:1874258812808960:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787432782.168720:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b92147780 going to sleep for 11 seconds 00000100:00100000:1.0:1787432782.176004:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b98b19180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5869:1874258812808960:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787432782.176059:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432782.176226:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432782.177125:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791832960 00000100:00100000:3.0:1787432782.177139:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791832960 00000100:00100000:3.0:1787432782.177227:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:3.0:1787432782.177239:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+44:5616:x1874258791832960:12345-192.168.202.15@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787432782.178201:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+45:5616:x1874258791832960:12345-192.168.202.15@tcp:35:ldlm_bl.0 Request processed in 954us (1966us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1787432782.178215:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:3.0:1787432782.186828:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432782.187111:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791833088 00000100:00100000:1.0:1787432782.187127:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791833088 00010000:00010000:1.0:1787432782.187181:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10507 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e30 expref: 45 pid: 8110 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432782.187260:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 66 00000100:00100000:1.0:1787432782.187270:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+45:2376:x1874258791833088:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432782.187294:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432782.187302:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10507 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e30 expref: 45 pid: 8110 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.187317:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10507 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e30 expref: 45 pid: 8110 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.187356:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10507 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e30 expref: 45 pid: 8110 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.187375:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:1.0:1787432782.187380:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.187391:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.187399:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10531 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.187430:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432782.187795:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+44:2376:x1874258791833088:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 524us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432782.187803:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 66 00010000:00010000:3.0:1787432782.188080:0:5869:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.188090:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432782.188152:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787432782.188157:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432782.188182:0:5869:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.188196:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.188207:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f10523 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.188225:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f10523 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.188233:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f10523 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.188239:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432782.188245:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f10523 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.188253:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f10523 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.188267:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:3.0:1787432782.188270:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432782.188274:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f10523 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.188280:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f10523 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.188294:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f1052a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.188300:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f1052a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.188307:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f1052a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.188312:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432782.188319:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f1052a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.188338:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f1052a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.188346:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff935ba2a69100) 00010000:00010000:3.0:1787432782.188348:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432782.188351:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f1052a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.188358:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6800/0xbcb9e331c3f1052a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.188403:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7400/0xbcb9e331c3f1051c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e37 expref: 44 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.188418:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e37 expref: 43 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.188425:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:3.0:1787432782.188427:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432782.188430:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e6000, rc 0) 00000100:00100000:3.0:1787432782.188470:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+43:11471:x1874258791832704:12345-192.168.202.15@tcp:101:stat.0 Request processed in 25370us (27407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432782.188478:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 156 00000100:00100000:0.0:1787432782.254250:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432782.254338:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791833344 00000100:00100000:2.0:1787432782.254351:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791833344 00000100:00100000:2.0:1787432782.254426:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 157 00000100:00100000:2.0:1787432782.254437:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+43:11477:x1874258791833344:12345-192.168.202.15@tcp:36:truncate.0 00010000:00010000:2.0:1787432782.254536:0:8110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432782.254572:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10531 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e37 expref: 43 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432782.254602:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:2.0:1787432782.254609:0:8110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432782.254950:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10538 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432782.254969:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432782.254998:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787432782.255059:0:8110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1787432782.255081:0:8110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003299abfa reply state 00000000a763d427 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432782.255092:0:8110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787432782.255209:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+45:11477:x1874258791833344:12345-192.168.202.15@tcp:36:truncate.0 Request processed in 772us (973us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787432782.255218:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 157 00000020:00080000:2.0:1787432782.255224:0:8110:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787432782.258730:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432782.258756:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10538 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432782.258766:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10538 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432782.258773:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432782.258779:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10538 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432782.258788:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10538 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432782.258810:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:2.0:1787432782.258813:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432782.258837:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10538 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432782.258844:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10538 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432782.397178:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432782.397389:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791833472 00000100:00100000:1.0:1787432782.397421:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791833472 00000100:00100000:1.0:1787432782.397500:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 158 00000100:00100000:1.0:1787432782.397519:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+44:11491:x1874258791833472:12345-192.168.202.15@tcp:101:stat.0 00010000:00010000:1.0:1787432782.397549:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432782.397585:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f1053f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e3e expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.397889:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f10546 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.397907:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f10546 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.397924:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f10546 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.397953:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1054d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.397961:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1054d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.397968:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1054d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398093:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f10554 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398102:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f10554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398108:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f10554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432782.398160:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1787432782.398164:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787432782.398192:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f10554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398206:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f10554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398214:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f10546 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398221:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f10546 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398228:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f10546 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398235:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e7200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432782.398240:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f10546 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398248:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f10546 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398264:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:1.0:1787432782.398267:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432782.398271:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f10546 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398279:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f10546 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398302:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1054d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398308:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1054d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398314:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1054d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398320:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6a00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432782.398323:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1054d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398329:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1054d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398335:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff935ba2a69f00) 00010000:00010000:1.0:1787432782.398337:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432782.398339:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1054d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398343:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1054d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398384:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f1053f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e3e expref: 46 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398398:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f10554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e3e expref: 45 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.398416:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:1.0:1787432782.398418:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432782.398421:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e6e00, rc 0) 00000100:00100000:1.0:1787432782.398497:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+45:11491:x1874258791833472:12345-192.168.202.15@tcp:101:stat.0 Request processed in 987us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432782.399118:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 158 00000100:00100000:0.0:1787432782.489503:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432782.489758:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791833728 00000100:00100000:3.0:1787432782.489773:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791833728 00000100:00100000:3.0:1787432782.489856:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 159 00000100:00100000:3.0:1787432782.489870:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+45:11501:x1874258791833728:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432782.489916:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432782.489948:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1055b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e45 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432782.490109:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787432782.490287:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1055b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e45 expref: 47 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.490307:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a200) 00010000:00010000:3.0:1787432782.490311:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432782.490319:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1055b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e45 expref: 47 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.490340:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154600, rc 0) 00000100:00100000:3.0:1787432782.490441:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+46:11501:x1874258791833728:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 575us (953us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1787432782.490450:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 159 00000100:00100000:3.0:1787432782.494798:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432782.494912:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791833984 00000100:00100000:1.0:1787432782.494926:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791833984 00000100:00100000:1.0:1787432782.495001:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:1.0:1787432782.495012:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8355d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+46:11501:x1874258791833984:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787432782.495376:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8355d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+47:11501:x1874258791833984:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 365us (592us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1787432782.495384:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:0.0:1787432782.561955:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432782.562167:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791834240 00000100:00100000:3.0:1787432782.562180:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791834240 00000100:00100000:3.0:1787432782.562257:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 160 00000100:00100000:3.0:1787432782.562269:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+47:11507:x1874258791834240:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:3.0:1787432782.562304:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432782.562329:0:6929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10569 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e4c expref: -99 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.562456:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10570 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.562489:0:6929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f10554 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e3e expref: 48 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.562499:0:6929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10570 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.562876:0:6929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f10554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e3e expref: 48 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.562894:0:6929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f10554 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e3e expref: 48 pid: 5868 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432782.562911:0:6929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6929:1874258812809088:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787432782.563045:0:6929:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b83008900 going to sleep for 11 seconds 00000100:00100000:3.0:1787432782.566748:0:6929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6929:1874258812809088:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787432782.566794:0:6929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10570 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432782.568859:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432782.568981:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791834368 00000100:00100000:1.0:1787432782.568993:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791834368 00010000:00010000:1.0:1787432782.569050:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f10554 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e3e expref: 49 pid: 5868 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432782.569100:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 67 00000100:00100000:1.0:1787432782.569111:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+49:2375:x1874258791834368:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432782.569130:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432782.569138:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f10554 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e3e expref: 49 pid: 5868 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.569153:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f10554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e3e expref: 49 pid: 5868 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.569200:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f10554 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e3e expref: 49 pid: 5868 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.569222:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:1.0:1787432782.569228:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10570 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.569239:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10570 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.569248:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10570 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.569279:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432782.569358:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+48:2375:x1874258791834368:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 248us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432782.569366:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 67 00010000:00010000:3.0:1787432782.570105:0:6929:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10570 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.570118:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10570 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432782.570145:0:6929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1787432782.570342:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10569 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e4c expref: 49 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.570383:0:6929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10570 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e4c expref: 48 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.570393:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:3.0:1787432782.570397:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787432782.570400:0:6929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154a00, rc 0) 00000100:00100000:3.0:1787432782.570445:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+48:11507:x1874258791834240:12345-192.168.202.15@tcp:101:bash.0 Request processed in 8180us (8509us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1787432782.570455:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 160 00000100:00100000:0.0:1787432782.574355:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432782.574447:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791834624 00000100:00100000:2.0:1787432782.574460:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791834624 00000100:00100000:2.0:1787432782.574614:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 161 00000100:00100000:2.0:1787432782.574626:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+48:11507:x1874258791834624:12345-192.168.202.15@tcp:36:bash.0 00010000:00010000:2.0:1787432782.575013:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1057e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432782.575035:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1057e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432782.575049:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1057e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787432782.575098:0:5867:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787432782.575118:0:5867:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000421ce6a9 reply state 000000005cea9509 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1057e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432782.575128:0:5867:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787432782.575279:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+51:11507:x1874258791834624:12345-192.168.202.15@tcp:36:bash.0 Request processed in 653us (935us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787432782.575286:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 161 00000020:00080000:2.0:1787432782.575291:0:5867:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787432782.581247:0:3317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1057e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.581272:0:3317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1057e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.581281:0:3317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1057e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.581288:0:3317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432782.581295:0:3317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1057e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.581303:0:3317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1057e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.581326:0:3317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:3.0:1787432782.581329:0:3317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432782.581335:0:3317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1057e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.581363:0:3317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1057e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432782.582453:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432782.582545:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791834752 00000100:00100000:2.0:1787432782.582560:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791834752 00000100:00100000:2.0:1787432782.582641:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 162 00000100:00100000:2.0:1787432782.582654:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+50:11507:x1874258791834752:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787432782.582741:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432782.582768:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10585 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e53 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432782.582886:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1058c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432782.582904:0:8110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10570 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e4c expref: 51 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432782.582913:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1058c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432782.582958:0:8110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10570 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e4c expref: 51 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432782.582974:0:8110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10570 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e4c expref: 51 pid: 6929 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432782.582990:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9929f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8110:1874258812809216:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432782.583106:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba0fdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432782.586877:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432782.586967:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791834880 00000100:00100000:3.0:1787432782.586979:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791834880 00010000:00010000:3.0:1787432782.587035:0:8489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10570 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e4c expref: 52 pid: 6929 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432782.587087:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 68 00000100:00100000:3.0:1787432782.587099:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9929c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+52:2376:x1874258791834880:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432782.587118:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432782.587127:0:8489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10570 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e4c expref: 52 pid: 6929 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.587143:0:8489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10570 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e4c expref: 52 pid: 6929 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.587172:0:8489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:3.0:1787432782.587178:0:8489:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1058c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.587190:0:8489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1058c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.587198:0:8489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1058c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.587221:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432782.587310:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9929c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+52:2376:x1874258791834880:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 213us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432782.587318:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 68 00010000:00010000:1.0:1787432782.587443:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10570 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e4c expref: 51 pid: 6929 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432782.587464:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9929f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8110:1874258812809216:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787432782.587491:0:8110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1058c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.587501:0:8110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1058c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.587507:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1058c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432782.587594:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787432782.587600:0:8110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787432782.587627:0:8110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1058c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.587725:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10585 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e53 expref: 51 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.587744:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1058c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e53 expref: 50 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.587752:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:1.0:1787432782.587755:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432782.587757:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f400, rc 0) 00000100:00100000:1.0:1787432782.587792:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+50:11507:x1874258791834752:12345-192.168.202.15@tcp:101:bash.0 Request processed in 5142us (5349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432782.587800:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 162 00000100:00100000:0.0:1787432782.593370:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432782.593477:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791835136 00000100:00100000:1.0:1787432782.593490:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791835136 00000100:00100000:1.0:1787432782.593560:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:1.0:1787432782.593573:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+50:11507:x1874258791835136:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:1.0:1787432782.593953:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+51:11507:x1874258791835136:12345-192.168.202.15@tcp:35:bash.0 Request processed in 381us (596us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787432782.593962:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:0.0:1787432782.690942:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432782.691062:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791835392 00000100:00100000:3.0:1787432782.691076:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791835392 00000100:00100000:3.0:1787432782.691161:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 163 00000100:00100000:3.0:1787432782.691174:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+51:11517:x1874258791835392:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432782.691209:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432782.691240:0:6929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10593 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e5a expref: -99 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432782.691419:0:6929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787432782.691585:0:6929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10593 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e5a expref: 53 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.691605:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a200) 00010000:00010000:3.0:1787432782.691608:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432782.691615:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10593 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e5a expref: 53 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.691635:0:6929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154600, rc 0) 00000100:00100000:3.0:1787432782.691940:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+52:11517:x1874258791835392:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 766us (1011us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1787432782.691948:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 163 00000100:00100000:2.0:1787432782.694180:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432782.694282:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791835520 00000100:00100000:3.0:1787432782.694296:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791835520 00000100:00100000:3.0:1787432782.694429:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 164 00000100:00100000:3.0:1787432782.694443:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb992b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+52:11517:x1874258791835520:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:3.0:1787432782.694594:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f105a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.694615:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f105a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.694628:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f105a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.694704:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f105a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.694713:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f105a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.694720:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f105a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.694865:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.694875:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.694882:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432782.694936:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.694952:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f105a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.694972:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f105a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.694979:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f105a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.694986:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432782.694992:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f105a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.695000:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f105a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.695013:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:3.0:1787432782.695016:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432782.695022:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f105a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.695027:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f105a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.695045:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f105a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.695050:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f105a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.695055:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f105a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.695060:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154a00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432782.695069:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f105a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.695075:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f105a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.695082:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff935b8304ab00) 00010000:00010000:3.0:1787432782.695084:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432782.695087:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f105a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.695094:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f105a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.695112:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.695117:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.695123:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.695128:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432782.695131:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.695136:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.695143:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:3.0:1787432782.695145:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432782.695152:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.695159:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432782.695249:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb992b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+52:11517:x1874258791835520:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 807us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432782.695257:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 164 00000100:00100000:0.0:1787432782.705095:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432782.710008:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791835776 00000100:00100000:1.0:1787432782.710036:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791835776 00000100:00100000:1.0:1787432782.710622:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:1.0:1787432782.710639:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+52:11517:x1874258791835776:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787432782.711103:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+53:11517:x1874258791835776:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 466us (6024us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1787432782.711112:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:0.0:1787432782.752453:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432782.752586:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791836032 00000100:00100000:1.0:1787432782.752603:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791836032 00000100:00100000:1.0:1787432782.752739:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 165 00000100:00100000:1.0:1787432782.752754:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+53:11520:x1874258791836032:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787432782.752790:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432782.752819:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f105b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e61 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.752925:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f105bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.752942:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f105bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.752956:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f105bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.752973:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f105c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.752980:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f105c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.752987:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f105c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.753179:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f105cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.753190:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f105cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.753198:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f105cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432782.753210:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787432782.753338:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f105bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.753348:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f105bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.753356:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f105bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.753362:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e7800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432782.753368:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f105bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.753376:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f105bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.753391:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:1.0:1787432782.753394:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432782.753398:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f105bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.753415:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f105bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.753432:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f105c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.753437:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f105c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.753442:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f105c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.753447:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6a00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432782.753449:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f105c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.753455:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f105c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.753462:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff935ba2a69f00) 00010000:00010000:1.0:1787432782.753464:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432782.753466:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f105c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.753472:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f105c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.753524:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f105b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e61 expref: 56 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.753539:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f105cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e61 expref: 55 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.753553:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:1.0:1787432782.753555:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432782.753559:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e7200, rc 0) 00000100:00100000:1.0:1787432782.753640:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+55:11520:x1874258791836032:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 889us (1199us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1787432782.753648:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 165 00000100:00100000:0.0:1787432782.764858:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432782.765156:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791836160 00000100:00100000:3.0:1787432782.765170:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791836160 00000100:00100000:3.0:1787432782.765306:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 166 00000100:00100000:3.0:1787432782.765319:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+55:11520:x1874258791836160:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:3.0:1787432782.765420:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.765445:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.765458:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.765507:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.765516:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.765524:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.765531:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432782.765551:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.765560:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.765574:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:3.0:1787432782.765578:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432782.765583:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.765590:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432782.765767:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+55:11520:x1874258791836160:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 450us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432782.765776:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 166 00000100:00100000:0.0:1787432782.776025:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432782.776139:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432782.776236:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791836544 00000100:00100000:2.0:1787432782.776250:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791836544 00000100:00100000:2.0:1787432782.776329:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:2.0:1787432782.776341:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+55:11520:x1874258791836544:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787432782.776723:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+56:11520:x1874258791836544:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 382us (582us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1787432782.776751:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:1.0:1787432782.778938:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791836288 00000100:00100000:1.0:1787432782.778959:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791836288 00000100:00100000:1.0:1787432782.779059:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:1.0:1787432782.779071:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86832300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+56:2376:x1874258791836288:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432782.779092:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432782.779128:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f105cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e61 expref: 56 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432782.779152:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:1.0:1787432782.779158:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432782.779242:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86832300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+55:2376:x1874258791836288:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 173us (3235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432782.779251:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00010000:00010000:1.0:1787432782.967519:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432782.971104:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432782.971352:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791836800 00000100:00100000:3.0:1787432782.971368:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791836800 00000100:00100000:3.0:1787432782.971457:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 167 00000100:00100000:3.0:1787432782.971470:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+55:11538:x1874258791836800:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:3.0:1787432782.971506:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432782.971537:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e68 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.971750:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f105e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.971772:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f105e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.971810:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f105e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432782.971826:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787432782.972001:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e68 expref: 58 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.972028:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f105e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e68 expref: 57 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432782.972039:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:3.0:1787432782.972043:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787432782.972048:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154a00, rc 0) 00000100:00100000:3.0:1787432782.974053:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+57:11538:x1874258791836800:12345-192.168.202.15@tcp:101:cat.0 Request processed in 2566us (2946us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787432782.974069:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 167 00000100:00100000:2.0:1787432783.007086:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432783.007294:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791836928 00000100:00100000:3.0:1787432783.007308:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791836928 00000100:00100000:3.0:1787432783.007391:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 168 00000100:00100000:3.0:1787432783.007403:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+57:11539:x1874258791836928:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432783.007437:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432783.007467:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e6f expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.007574:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f105fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.007616:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f105fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.007630:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f105fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432783.007775:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787432783.007780:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432783.007808:0:5869:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f105fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.007846:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f105f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e6f expref: 59 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.007874:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f105fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e6f expref: 58 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.007886:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:3.0:1787432783.007889:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432783.007893:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155200, rc 0) 00000100:00100000:3.0:1787432783.007966:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+58:11539:x1874258791836928:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 565us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432783.007974:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 168 00000100:00100000:0.0:1787432783.012987:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432783.013142:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791837312 00000100:00100000:3.0:1787432783.013158:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791837312 00000100:00100000:3.0:1787432783.013237:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:3.0:1787432783.013250:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+58:11539:x1874258791837312:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:3.0:1787432783.013738:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+59:11539:x1874258791837312:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 489us (766us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787432783.013768:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:0.0:1787432783.015737:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432783.016080:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791837440 00000100:00100000:3.0:1787432783.016092:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791837440 00000100:00100000:3.0:1787432783.016315:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:3.0:1787432783.016330:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b909b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+59:11539:x1874258791837440:12345-192.168.202.15@tcp:103:lfs.0 00010000:00010000:3.0:1787432783.016357:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787432783.016391:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1058c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e53 expref: 59 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.016422:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f105e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e68 expref: 58 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.016439:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10497 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e14 expref: 57 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.016453:0:8489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304a500) 00010000:00010000:3.0:1787432783.016466:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432783.016590:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b909b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+56:11539:x1874258791837440:12345-192.168.202.15@tcp:103:lfs.0 Request processed in 263us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432783.016599:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:2.0:1787432783.038786:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432783.038957:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791837568 00000100:00100000:3.0:1787432783.038971:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791837568 00000100:00100000:3.0:1787432783.039069:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 169 00000100:00100000:3.0:1787432783.039084:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+56:11539:x1874258791837568:12345-192.168.202.15@tcp:58:lfs.0 00010000:00010000:3.0:1787432783.039264:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10603 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.039295:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10603 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.039310:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10603 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787432783.039594:0:6929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787432783.040219:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+56:11539:x1874258791837568:12345-192.168.202.15@tcp:58:lfs.0 Request processed in 1133us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432783.040233:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 169 00000100:00100000:0.0:1787432783.065492:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432783.066016:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791837696 00000100:00100000:3.0:1787432783.066038:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791837696 00000100:00100000:3.0:1787432783.066122:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 170 00000100:00100000:3.0:1787432783.066135:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+56:11541:x1874258791837696:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432783.066163:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432783.066190:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f1060a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e76 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.066305:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10611 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.066323:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10611 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.066336:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10611 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.066353:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10618 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.066371:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.066377:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.066508:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1061f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.066517:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1061f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.066523:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1061f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432783.066569:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787432783.066586:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432783.066618:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1061f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.066632:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1061f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.066641:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10611 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.066648:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10611 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.069257:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10611 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.069315:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154a00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432783.069322:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10611 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.069333:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10611 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.069359:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:3.0:1787432783.069362:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432783.069369:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10611 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.069377:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10611 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.069409:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.069415:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10618 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.069421:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10618 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.069425:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432783.069427:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10618 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.069433:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10618 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.069453:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff935b8304a500) 00010000:00010000:3.0:1787432783.069456:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432783.069460:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10618 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.069467:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f10618 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.069548:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f1060a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e76 expref: 58 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.069566:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1061f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e76 expref: 57 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.069574:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:3.0:1787432783.069576:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432783.069579:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154000, rc 0) 00000100:00100000:2.0:1787432783.070959:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+57:11541:x1874258791837696:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 4814us (5471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432783.070971:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 170 00000040:00080000:3.0:1787432783.605974:0:11725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787432783.605989:0:11725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787432783.606061:0:11725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787432783.606069:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787432783.606240:0:11725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5d9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11725:1874258812809344:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787432783.606395:0:11725:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b83008b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432783.611867:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432783.612071:0:11725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5d9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11725:1874258812809344:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787432783.612257:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791837824 00000100:00100000:0.0:1787432783.612270:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791837824 00000100:00100000:0.0:1787432783.612350:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 171 00000100:00100000:0.0:1787432783.612363:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+57:11552:x1874258791837824:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787432783.612410:0:5868:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787432783.612566:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+57:11552:x1874258791837824:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 205us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432783.612575:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 171 00000100:00100000:0.0:1787432783.628288:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432783.629881:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791837952 00000100:00100000:3.0:1787432783.629906:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791837952 00000100:00100000:3.0:1787432783.632894:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 172 00000100:00100000:3.0:1787432783.632951:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+57:11552:x1874258791837952:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787432783.633070:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10626 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633091:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10626 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633108:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10626 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633127:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1062d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633133:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1062d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633139:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1062d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633177:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10634 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633186:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633193:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432783.633244:0:6929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787432783.633249:0:6929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432783.633266:0:6929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633290:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10626 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633296:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10626 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633304:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10626 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633309:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432783.633314:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10626 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633322:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10626 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633336:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff935b8304a100) 00010000:00010000:3.0:1787432783.633339:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432783.633344:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10626 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633350:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10626 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633368:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1062d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633375:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1062d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633381:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1062d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633393:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432783.633397:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1062d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633403:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1062d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633411:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff935b8304a500) 00010000:00010000:3.0:1787432783.633414:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432783.633417:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1062d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633423:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1062d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633440:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633447:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10634 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633453:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10634 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633458:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154a00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432783.633461:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10634 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633468:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10634 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633488:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:3.0:1787432783.633491:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432783.633494:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10634 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.633500:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10634 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432783.633632:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+57:11552:x1874258791837952:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 Request processed in 694us (5361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432783.633641:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 172 00000100:00100000:2.0:1787432783.651081:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432783.651151:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791838208 00000100:00100000:3.0:1787432783.651165:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791838208 00000100:00100000:3.0:1787432783.651260:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 173 00000100:00100000:3.0:1787432783.651273:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+57:11552:x1874258791838208:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432783.651300:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432783.651327:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f1063b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e7d expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.651459:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10642 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.651477:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.651490:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432783.651503:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787432783.651852:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10642 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.651861:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10642 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.651867:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10642 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.651873:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432783.651878:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10642 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.651886:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10642 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.651900:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:3.0:1787432783.651903:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432783.651908:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10642 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.651913:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10642 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.651962:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f1063b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e7d expref: 59 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.651973:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff935b8304a100) 00010000:00010000:3.0:1787432783.651975:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432783.651979:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f1063b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e7d expref: 59 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.652001:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80031400, rc 0) 00000100:00100000:3.0:1787432783.652076:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+58:11552:x1874258791838208:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 805us (1009us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787432783.652084:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 173 00000100:00100000:2.0:1787432783.674353:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432783.674473:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791838336 00000100:00100000:3.0:1787432783.674489:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791838336 00000100:00100000:3.0:1787432783.674584:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 174 00000100:00100000:3.0:1787432783.674597:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+58:11552:x1874258791838336:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787432783.674688:0:8110:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787432783.674828:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+58:11552:x1874258791838336:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 233us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432783.674838:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 174 00000100:00100000:2.0:1787432783.691168:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432783.691315:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791838592 00000100:00100000:3.0:1787432783.691328:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791838592 00000100:00100000:3.0:1787432783.691406:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 175 00000100:00100000:3.0:1787432783.691418:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+58:11552:x1874258791838592:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432783.691444:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432783.691448:0:6929:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787432783.691480:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f105fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e6f expref: 58 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.691503:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:3.0:1787432783.691508:0:6929:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432783.691523:0:6929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f10650 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e84 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787432783.692132:0:6929:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787432783.692377:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10657 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.692394:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.692405:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.692465:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f10650 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e84 expref: 60 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.692485:0:6929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10657 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e84 expref: 59 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.692495:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff935b8304a500) 00010000:00010000:3.0:1787432783.692498:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432783.692501:0:6929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80030000, rc 0) 00000100:00100000:3.0:1787432783.692576:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+59:11552:x1874258791838592:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 1160us (1423us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787432783.692585:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 175 00000100:00100000:2.0:1787432783.701214:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432783.701300:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791838848 00000100:00100000:3.0:1787432783.701315:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791838848 00000100:00100000:3.0:1787432783.701390:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 176 00000100:00100000:3.0:1787432783.701402:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+59:11552:x1874258791838848:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787432783.701486:0:5867:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432783.701539:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10657 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e84 expref: 59 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.701561:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff935b8304a500) 00010000:00010000:3.0:1787432783.701573:0:5867:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432783.701600:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f10665 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.701616:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f10665 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.701627:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f10665 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.701646:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f1066c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x65d7be4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.701691:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f1066c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x65d7be4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.701698:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f1066c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x65d7be4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.701802:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f10665 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.701809:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f10665 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.701815:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f10665 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.701822:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031c00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432783.701833:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f10665 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.701841:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f10665 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.701850:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:3.0:1787432783.701853:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432783.701856:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f10665 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.701862:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f10665 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.701874:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f1066c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x65d7be4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.701880:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f1066c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x65d7be4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.701886:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f1066c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x65d7be4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.701891:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432783.701894:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f1066c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x65d7be4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.701898:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f1066c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x65d7be4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.701905:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x65d7be4b (ffff935b8304ae00) 00010000:00010000:3.0:1787432783.701906:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432783.701915:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f1066c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x65d7be4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.701921:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f1066c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x65d7be4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432783.702032:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+58:11552:x1874258791838848:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 631us (833us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787432783.702042:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 176 00000100:00100000:2.0:1787432783.706792:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432783.706850:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791838976 00000100:00100000:1.0:1787432783.706865:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791838976 00000100:00100000:1.0:1787432783.707076:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 177 00000100:00100000:1.0:1787432783.707091:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+58:11552:x1874258791838976:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787432783.707122:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432783.707173:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f10673 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e8b expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432783.707225:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f1067a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432783.707242:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f1067a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432783.707255:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f1067a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432783.707379:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f10673 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e8b expref: 60 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432783.707397:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f1067a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e8b expref: 59 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432783.707406:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff935ba2a69900) 00010000:00010000:1.0:1787432783.707409:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787432783.707412:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e7800, rc 0) 00000100:00100000:1.0:1787432783.707497:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+59:11552:x1874258791838976:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 409us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432783.707505:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 177 00000100:00100000:1.0:1787432783.715801:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432783.716827:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791839232 00000100:00100000:0.0:1787432783.716845:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791839232 00000100:00100000:0.0:1787432783.716925:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 178 00000100:00100000:0.0:1787432783.716937:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+59:11552:x1874258791839232:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787432783.717071:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10681 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432783.717110:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432783.717124:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787432783.717554:0:5868:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1787432783.717568:0:5868:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 418382909388ns, next at 419382906085ns, rc = 0 00000004:00010000:0.0:1787432783.717727:0:5868:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017e4da39 reply state 00000000616e7baa transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432783.717738:0:5868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787432783.717871:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+61:11552:x1874258791839232:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 934us (2078us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1787432783.717880:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 178 00010000:00010000:1.0:1787432783.725226:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432783.725251:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10681 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432783.725285:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10681 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432783.725289:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:1.0:1787432783.725292:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1ce400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432783.725299:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10681 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432783.725309:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10681 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432783.725331:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff935ba2a69900) 00010000:00010000:1.0:1787432783.725335:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787432783.725341:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10681 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432783.725347:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10681 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432783.729042:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791839360 00000100:00100000:3.0:1787432783.729064:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791839360 00000100:00100000:3.0:1787432783.729136:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 179 00000100:00100000:3.0:1787432783.729150:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+60:11552:x1874258791839360:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432783.729185:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432783.729211:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10688 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e92 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.729285:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10688 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e92 expref: 61 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.729299:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10688 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e92 expref: 61 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.729319:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff935ba2a69900) 00010000:00010000:3.0:1787432783.729322:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787432783.729326:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154a00, rc 0) 00000100:00100000:3.0:1787432783.729406:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+61:11552:x1874258791839360:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 258us (4123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432783.729414:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 179 00000100:00100000:1.0:1787432783.733810:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432783.733884:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791839488 00000100:00100000:0.0:1787432783.733899:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791839488 00000100:00100000:0.0:1787432783.734002:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:0.0:1787432783.734016:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2376:x1874258791839488:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787432783.734498:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+7:2376:x1874258791839488:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 472us (690us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787432783.734507:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00080000:3.0:1787432783.734577:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432783.749215:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432783.752302:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791839744 00000100:00100000:0.0:1787432783.752328:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791839744 00000100:00100000:0.0:1787432783.752424:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:0.0:1787432783.752439:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+61:11552:x1874258791839744:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787432783.752873:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+62:11552:x1874258791839744:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 435us (3668us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787432783.752882:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:1.0:1787432783.758630:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432783.758776:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791840000 00000100:00100000:0.0:1787432783.758790:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791840000 00000100:00100000:0.0:1787432783.758869:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 180 00000100:00100000:0.0:1787432783.758883:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+62:11552:x1874258791840000:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787432783.759037:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+62:11552:x1874258791840000:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 156us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432783.759046:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 180 00000100:00100000:1.0:1787432783.777009:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432783.777098:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791840128 00000100:00100000:2.0:1787432783.777115:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791840128 00000100:00100000:2.0:1787432783.777199:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 181 00000100:00100000:2.0:1787432783.777212:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+62:11552:x1874258791840128:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787432783.777242:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432783.777272:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1068f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025e99 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432783.777362:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f10696 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432783.777381:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f10696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432783.777394:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f10696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432783.777470:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787432783.777496:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f10696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432783.777532:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1068f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e99 expref: 64 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432783.777557:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f10696 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e99 expref: 63 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432783.777568:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff935ba2a69900) 00010000:00010000:2.0:1787432783.777571:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787432783.777577:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e600, rc 0) 00000100:00100000:2.0:1787432783.784078:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+63:11552:x1874258791840128:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 6847us (7058us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432783.784098:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 181 00000100:00100000:3.0:1787432783.794988:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432783.795046:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791840256 00000100:00100000:3.0:1787432783.795060:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791840256 00000100:00100000:3.0:1787432783.795135:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:3.0:1787432783.795147:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+7:2375:x1874258791840256:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432783.795173:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432783.795204:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a67bc88e/0xbcb9e331c3f1069d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025ea0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432783.795240:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a0f4f, blocks: 0x1 00010000:00010000:3.0:1787432783.795283:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1787432783.795288:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432783.795302:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a67bc88e/0xbcb9e331c3f1069d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ea0 expref: 8 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.795326:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a67bc88e/0xbcb9e331c3f1069d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ea0 expref: 8 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.795344:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155200, rc 0) 00000100:00100000:3.0:1787432783.795424:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+8:2375:x1874258791840256:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 278us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432783.795432:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:2.0:1787432783.815851:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432783.816007:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791840512 00000100:00100000:3.0:1787432783.816024:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791840512 00000100:00100000:3.0:1787432783.816172:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 182 00000100:00100000:3.0:1787432783.816186:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+63:11552:x1874258791840512:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787432783.816357:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+63:11552:x1874258791840512:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 173us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432783.816366:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 182 00000100:00100000:1.0:1787432783.828907:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432783.829014:0:12109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791840640 00000100:00100000:3.0:1787432783.829030:0:12109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791840640 00000100:00100000:3.0:1787432783.829107:0:12109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:3.0:1787432783.829121:0:12109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+8:11552:x1874258791840640:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432783.829146:0:12109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432783.829172:0:12109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f106a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025ea7 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.829216:0:12109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a67bc88e/0xbcb9e331c3f1069d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ea0 expref: 9 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.829225:0:12109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432783.829230:0:12109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432783.829237:0:12109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f106a4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ea7 expref: 9 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.829278:0:12109:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a67bc88e/0xbcb9e331c3f1069d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ea0 expref: 9 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.829295:0:12109:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a67bc88e/0xbcb9e331c3f1069d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ea0 expref: 9 pid: 8446 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432783.829310:0:12109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12109:1874258812809472:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787432783.829441:0:12109:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b878553c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432783.838237:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432783.838356:0:12109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12109:1874258812809472:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787432783.838402:0:12109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f106a4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025ea7 expref: 9 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432783.838428:0:12109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154600, rc 0) 00000100:00100000:0.0:1787432783.838501:0:12109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+9:11552:x1874258791840640:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 9383us (9610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432783.838520:0:12109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:2.0:1787432783.838616:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791840768 00000100:00100000:2.0:1787432783.838626:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791840768 00010000:00010000:2.0:1787432783.838704:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a67bc88e/0xbcb9e331c3f1069d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ea0 expref: 9 pid: 8446 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432783.838740:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:2.0:1787432783.838750:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+9:2376:x1874258791840768:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432783.838767:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432783.838795:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a67bc88e/0xbcb9e331c3f1069d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ea0 expref: 9 pid: 8446 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432783.838821:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a67bc88e/0xbcb9e331c3f1069d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ea0 expref: 9 pid: 8446 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432783.838851:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a67bc88e/0xbcb9e331c3f1069d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ea0 expref: 9 pid: 8446 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432783.838866:0:5852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432783.838871:0:5852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432783.838881:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f106a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025ea7 expref: 8 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432783.838892:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f106a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025ea7 expref: 8 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432783.838929:0:5852:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f106a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025ea7 expref: 8 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432783.838945:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba734700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5852:1874258812809600:192.168.202.15@tcp:105: 00000100:00100000:2.0:1787432783.839005:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba0fd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432783.852453:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432783.852577:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba734700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5852:1874258812809600:192.168.202.15@tcp:105: 00010000:00010000:2.0:1787432783.852615:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432783.853201:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+8:2376:x1874258791840768:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 14446us (14975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432783.853215:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:3.0:1787432783.855302:0:6730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791840896 00000100:00100000:3.0:1787432783.855324:0:6730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791840896 00002000:00100000:2.0:1787432783.855474:0:6730:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff935bbae5b480 x1874258791840896/t0(0) o4->ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp:494/0 lens 504/0 e 0 to 0 dl 1787432794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787432783.855488:0:6730:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935bbae5b480 with x1874258791840896 ext(0->8) 00002000:00010000:2.0:1787432783.855496:0:6730:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff935bbae5b480 00000100:00100000:2.0:1787432783.855538:0:6730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:2.0:1787432783.855551:0:6730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ee8b542c-0113-490f-a721-62606ee0807f+8:2375:x1874258791840896:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787432783.856173:0:6730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ee8b542c-0113-490f-a721-62606ee0807f+10:2375:x1874258791840896:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 Request processed in 620us (3733us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787432783.856183:0:6730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00002000:00100000:2.0:1787432783.856190:0:6730:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff935bbae5b480 x1874258791840896/t4294967314(0) o4->ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp:494/0 lens 504/448 e 0 to 0 dl 1787432794 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787432783.856200:0:6730:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935bbae5b480 with x1874258791840896 ext(0->8) 00002000:00010000:2.0:1787432783.856205:0:6730:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff935bbae5b480 00000100:00100000:3.0:1787432783.859498:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432783.859623:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791841024 00000100:00100000:0.0:1787432783.859643:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791841024 00000100:00100000:0.0:1787432783.859949:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 183 00000100:00100000:0.0:1787432783.859962:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+63:11552:x1874258791841024:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787432783.928975:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+63:11552:x1874258791841024:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 Request processed in 68998us (69476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432783.928994:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 183 00000001:00080000:3.0:1787432783.929044:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1787432783.929056:0:5889:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1787432783.929084:0:5889:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff935ba051d240 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787432783.929089:0:5889:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff935bbb516400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff935b84b28240 00000020:00080000:3.0:1787432783.929092:0:5889:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff935bbb516e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff935a84a04800 00000004:00080000:3.0:1787432783.929133:0:5889:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:3.0:1787432783.929516:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812809728:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787432783.929586:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432783.929711:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812809728 00000100:00100000:3.0:1787432783.929721:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812809728 00000100:00100000:3.0:1787432783.929784:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787432783.929795:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3330:x1874258812809728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787432783.929829:0:6725:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1787432783.929868:0:6725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8a0f4d, atime: 0x0, ctime: 0x6a8a0f4d, blocks: 0xb 00010000:00010000:3.0:1787432783.929877:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a67bc88e/0xbcb9e331c3f106ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.929897:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1787432783.929901:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432783.929924:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a67bc88e/0xbcb9e331c3f106ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.929944:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a67bc88e/0xbcb9e331c3f106ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.929955:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a67bc88e/0xbcb9e331c3f106ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.929963:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a67bc88e/0xbcb9e331c3f106ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.929983:0:6725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787432783.930589:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3330:x1874258812809728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 794us (1002us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787432783.930598:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1787432783.930627:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787432783.930642:0:5855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432783.930688:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a67bc88e/0xbcb9e331c3f106ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.930700:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155200 already unused, calling callback (ffffffffc1752230) 00010000:00010000:3.0:1787432783.930707:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a67bc88e/0xbcb9e331c3f106ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.930718:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a67bc88e/0xbcb9e331c3f106ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.930756:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a67bc88e/0xbcb9e331c3f106ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.930764:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a67bc88e/0xbcb9e331c3f106ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432783.930792:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432783.930794:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432783.930796:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787432783.930841:0:3330:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff935bb9fd3480/2, rc 0, transno 4294967307 00000100:00100000:3.0:1787432783.930849:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812809728:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1787432783.931163:0:5900:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1787432783.931303:0:5900:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787432783.931310:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432783.931322:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812809856:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787432783.931372:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432783.931424:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812809856 00000100:00100000:2.0:1787432783.931430:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812809856 00000100:00100000:2.0:1787432783.931480:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787432783.931488:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812809856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787432783.933858:0:6724:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787432783.933871:0:6724:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787432784 00002000:00010000:2.0:1787432783.933874:0:6724:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787432783.933900:0:6724:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787432783 -> 1787432784 00002000:00010000:2.0:1787432783.933902:0:6724:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787432783.934027:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3330:x1874258812809856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2533us (2648us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787432783.934042:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1787432783.934119:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787432783.934172:0:3330:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff935bba734700/2, rc 0, transno 4294967315 00000100:00100000:2.0:1787432783.934179:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812809856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787432783.937847:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432783.938980:0:12109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791841152 00000100:00100000:3.0:1787432783.939000:0:12109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791841152 00000100:00100000:3.0:1787432783.940431:0:12109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:3.0:1787432783.940457:0:12109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+10:2376:x1874258791841152:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1787432783.991391:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787432784.005779:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1787432784.005803:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:0.0:1787432784.005817:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1787432784.006303:0:12109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+7:2376:x1874258791841152:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 Request processed in 65847us (68461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432784.006318:0:12109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:1.0:1787432784.011406:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432784.011478:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791841408 00000100:00100000:1.0:1787432784.011491:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791841408 00000100:00100000:1.0:1787432784.012399:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 184 00000100:00100000:1.0:1787432784.012415:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+18:11552:x1874258791841408:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787432784.012498:0:5867:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432784.012839:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f10696 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e99 expref: 18 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.012866:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff935ba2a69900) 00010000:00010000:1.0:1787432784.012874:0:5867:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432784.012918:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f106b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.012935:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f106b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.012948:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f106b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787432784.013303:0:5867:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001600eb99 reply state 000000003255f421 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f106b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432784.013314:0:5867:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787432784.013461:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+19:11552:x1874258791841408:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 1047us (2063us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787432784.013471:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 184 00000100:00080000:3.0:1787432784.013839:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432784.031498:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:3.0:1787432784.031535:0:3317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f106b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.031550:0:3317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f106b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.031577:0:3317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f106b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.031583:0:3317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432784.031589:0:3317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f106b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.031599:0:3317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f106b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.031619:0:3317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff935ba2a69900) 00010000:00010000:3.0:1787432784.031623:0:3317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432784.031629:0:3317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f106b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.031644:0:3317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f106b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432784.031782:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791841536 00000100:00100000:3.0:1787432784.031795:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791841536 00000100:00100000:3.0:1787432784.031854:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:3.0:1787432784.031865:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+7:2375:x1874258791841536:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787432784.032177:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787432784.032181:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787432784 -> 1787432782 00002000:00010000:3.0:1787432784.032184:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787432781 00002000:00010000:3.0:1787432784.032187:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787432784 -> 1787432782 00002000:00010000:3.0:1787432784.032189:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787432784.032268:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+8:2375:x1874258791841536:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 403us (784us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787432784.032285:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:1.0:1787432784.035740:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432784.035897:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791841792 00000100:00100000:3.0:1787432784.035910:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791841792 00000100:00100000:3.0:1787432784.035986:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 185 00000100:00100000:3.0:1787432784.035998:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+18:11552:x1874258791841792:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787432784.036094:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f106b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.036117:0:8110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f1067a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e8b expref: 18 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.036128:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f106b9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.036178:0:8110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f1067a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e8b expref: 18 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.036194:0:8110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f1067a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e8b expref: 18 pid: 5869 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432784.036211:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8110:1874258812809984:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787432784.036319:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87855900 going to sleep for 11 seconds 00000100:00100000:3.0:1787432784.039532:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432784.039617:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8110:1874258812809984:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787432784.039698:0:8110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f106b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432784.039865:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791841920 00000100:00100000:1.0:1787432784.039875:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791841920 00010000:00010000:1.0:1787432784.039923:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f1067a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e8b expref: 19 pid: 5869 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432784.039984:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 70 00000100:00100000:1.0:1787432784.039997:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86832300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+19:2375:x1874258791841920:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432784.040017:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432784.040026:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f1067a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e8b expref: 19 pid: 5869 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.040039:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f1067a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e8b expref: 19 pid: 5869 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.040065:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f1067a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e8b expref: 19 pid: 5869 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.040083:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff935ba2a69900) 00010000:00010000:1.0:1787432784.040089:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f106b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.040100:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f106b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.040108:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f106b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.040133:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432784.040191:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86832300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+18:2375:x1874258791841920:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 196us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432784.040199:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 70 00010000:00010000:1.0:1787432784.040226:0:8110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f106b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.040238:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f106b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.040275:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f106b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.040283:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f106b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.040290:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f106b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.040297:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031c00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432784.040301:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f106b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.040309:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f106b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.040317:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff935ba2a69900) 00010000:00010000:1.0:1787432784.040320:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787432784.040323:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f106b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.040329:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f106b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432784.040369:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+17:11552:x1874258791841792:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 Request processed in 4374us (4645us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787432784.040378:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 185 00000100:00100000:3.0:1787432784.043712:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432784.043814:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791842048 00000100:00100000:2.0:1787432784.043829:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791842048 00000100:00100000:2.0:1787432784.043905:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 58 00000100:00100000:2.0:1787432784.043917:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+8:2376:x1874258791842048:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787432784.043989:0:6726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003491d711/0xbcb9e331c3f106c0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.044017:0:6726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f106a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025ea7 expref: 8 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.044027:0:6726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432784.044033:0:6726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432784.044038:0:6726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003491d711/0xbcb9e331c3f106c0 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.044085:0:6726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f106a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x93816182a025ea7 expref: 8 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.044103:0:6726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f106a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025ea7 expref: 8 pid: 12109 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432784.044142:0:6726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6726:1874258812810112:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432784.044247:0:6726:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b98bf4540 going to sleep for 11 seconds 00000100:00100000:1.0:1787432784.048411:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432784.048747:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791842176 00000100:00100000:0.0:1787432784.048761:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791842176 00010000:00010000:0.0:1787432784.048817:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f106a4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025ea7 expref: 9 pid: 12109 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432784.048866:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 71 00000100:00100000:0.0:1787432784.048878:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+9:2376:x1874258791842176:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432784.048898:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432784.048930:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f106a4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025ea7 expref: 9 pid: 12109 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.048947:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f106a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025ea7 expref: 9 pid: 12109 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.048984:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432784.048990:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432784.048997:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003491d711/0xbcb9e331c3f106c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.049014:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003491d711/0xbcb9e331c3f106c0 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.049043:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432784.049093:0:6726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f106a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025ea7 expref: 9 pid: 12109 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432784.049113:0:6726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6726:1874258812810112:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787432784.049142:0:6726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003491d711/0xbcb9e331c3f106c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.049154:0:6726:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003491d711/0xbcb9e331c3f106c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.049162:0:6726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003491d711/0xbcb9e331c3f106c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.049193:0:6726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003491d711/0xbcb9e331c3f106c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.049203:0:6726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003491d711/0xbcb9e331c3f106c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.049213:0:6726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003491d711/0xbcb9e331c3f106c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.049246:0:6726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e200 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432784.049252:0:6726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003491d711/0xbcb9e331c3f106c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.049262:0:6726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003491d711/0xbcb9e331c3f106c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.049277:0:6726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003491d711/0xbcb9e331c3f106c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.049285:0:6726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003491d711/0xbcb9e331c3f106c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432784.050537:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+8:2376:x1874258791842176:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 1636us (2119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432784.050554:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 71 00000100:00100000:3.0:1787432784.060401:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+7:2376:x1874258791842048:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 Request processed in 16463us (16684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432784.060422:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 58 00000100:00100000:1.0:1787432784.064095:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432784.064219:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791842432 00000100:00100000:3.0:1787432784.064233:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791842432 00000100:00100000:3.0:1787432784.064347:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 186 00000100:00100000:3.0:1787432784.064361:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+17:11552:x1874258791842432:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787432784.064473:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f106c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.064495:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f106c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.064512:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f106c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.069547:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f106ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.069599:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10688 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e92 expref: 18 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.069610:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f106ce lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.069865:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10688 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e92 expref: 18 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.069899:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10688 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e92 expref: 18 pid: 8110 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432784.069919:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a85a9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5868:1874258812810240:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787432784.070051:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87855900 going to sleep for 11 seconds 00000100:00100000:2.0:1787432784.075830:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a85a9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5868:1874258812810240:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787432784.075892:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f106ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432784.076026:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432784.077539:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791842560 00000100:00100000:2.0:1787432784.077554:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791842560 00010000:00010000:2.0:1787432784.077618:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10688 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e92 expref: 19 pid: 8110 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432784.077693:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 72 00000100:00100000:2.0:1787432784.077705:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+19:2376:x1874258791842560:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432784.077725:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432784.077742:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10688 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e92 expref: 19 pid: 8110 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.077758:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10688 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e92 expref: 19 pid: 8110 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.077787:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10688 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e92 expref: 19 pid: 8110 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.077809:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff935ba2a69900) 00010000:00010000:2.0:1787432784.077815:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f106ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.077826:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f106ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.077834:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f106ce lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.077862:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432784.077931:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+18:2376:x1874258791842560:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 227us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432784.077940:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 72 00010000:00010000:2.0:1787432784.077972:0:5868:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f106ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.077980:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f106ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787432784.078213:0:5868:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1787432784.078374:0:5868:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1787432784.078432:0:5868:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1787432784.078539:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5868:1874258812810368:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787432784.078614:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432784.078708:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b98bf40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432784.079829:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812810368 00000100:00100000:2.0:1787432784.079841:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812810368 00000100:00100000:2.0:1787432784.079894:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787432784.079903:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5868:x1874258812810368:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787432784.080014:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5868:x1874258812810368:12345-0@lo:1000:mdt00_001.0 Request processed in 111us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432784.080022:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787432784.080066:0:5868:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1787432784.080072:0:5868:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff935bba734700, transno 4294967315 00000100:00100000:2.0:1787432784.080084:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5868:1874258812810368:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787432784.080589:0:5868:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1787432784.081351:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5868:1874258812810496:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787432784.081410:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432784.081440:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b98bf4540 going to sleep for 11 seconds 00000100:00100000:1.0:1787432784.081837:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812810496 00000100:00100000:1.0:1787432784.081845:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812810496 00000100:00100000:1.0:1787432784.081893:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787432784.081903:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5868:x1874258812810496:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787432784.082118:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5868:x1874258812810496:12345-0@lo:1000:mdt00_001.0 Request processed in 216us (707us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787432784.082126:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787432784.082173:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9557480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5868:1874258812810496:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787432784.082213:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f106ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.082225:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f106ce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.082234:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f106ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.082240:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432784.082245:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f106ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.082254:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f106ce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.082271:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff935ba2a69900) 00010000:00010000:1.0:1787432784.082282:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787432784.082289:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f106ce lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.082295:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f106ce lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.082336:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10603 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.082342:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10603 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.082348:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10603 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.082353:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432784.082355:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10603 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.082361:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10603 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.082368:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:1.0:1787432784.082370:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787432784.082373:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10603 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.082378:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10603 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.082402:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f106d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.082427:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1061f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025e76 expref: 21 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.082438:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f106d5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.082467:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1061f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e76 expref: 21 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.082482:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1061f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e76 expref: 21 pid: 5867 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432784.082496:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a852bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5868:1874258812810624:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787432784.082571:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb9563840 going to sleep for 11 seconds 00000100:00100000:2.0:1787432784.089796:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a852bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5868:1874258812810624:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787432784.089839:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f106d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432784.094536:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432784.094737:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791842688 00000100:00100000:3.0:1787432784.094751:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791842688 00010000:00010000:3.0:1787432784.094814:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1061f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e76 expref: 22 pid: 5867 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432784.094860:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 73 00000100:00100000:3.0:1787432784.094872:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba734700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+22:2375:x1874258791842688:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432784.094892:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432784.094900:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1061f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e76 expref: 22 pid: 5867 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.094916:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1061f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e76 expref: 22 pid: 5867 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.094948:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1061f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025e76 expref: 22 pid: 5867 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.094973:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:3.0:1787432784.094979:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f106d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.095008:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f106d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.095016:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f106d5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.095049:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432784.095126:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba734700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+21:2375:x1874258791842688:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 255us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432784.095133:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 73 00010000:00010000:3.0:1787432784.095164:0:5868:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f106d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.095173:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f106d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.095187:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f106d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.095196:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f106d5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.095202:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f106d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.095208:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e7800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432784.095213:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f106d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.095221:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f106d5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.095239:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:3.0:1787432784.095242:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432784.095246:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f106d5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.095253:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f106d5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.095263:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f106c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.095270:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f106c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.095275:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f106c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.095281:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432784.095283:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f106c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.095288:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f106c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.095295:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b8304ab00) 00010000:00010000:3.0:1787432784.095298:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787432784.095301:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f106c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.095307:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f106c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432784.095584:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+20:11552:x1874258791842432:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 31225us (31504us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787432784.095593:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 186 00000020:00080000:3.0:1787432784.095598:0:5868:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787432784.095771:0:11725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787432784.095777:0:11725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787432784.096264:0:11725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1787432784.096273:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787432784.100346:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432784.105043:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791842944 00000100:00100000:2.0:1787432784.105065:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791842944 00000100:00100000:2.0:1787432784.105170:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:2.0:1787432784.105184:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8355c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+20:11552:x1874258791842944:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787432784.107417:0:5870:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787432784.109996:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1787432784.110119:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f106dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.110144:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f106dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.110159:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f106dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.110169:0:5870:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f106dc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.110176:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f106dc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.110184:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f106dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.110274:0:5870:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787432784.110440:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8355c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+22:11552:x1874258791842944:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 5250us (10103us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1787432784.110452:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 50 00000020:00080000:2.0:1787432784.110460:0:5870:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787432784.116434:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432784.116454:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f106dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.116466:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e200 already unused, calling callback (ffffffffc1752230) 00010000:00010000:3.0:1787432784.116472:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f106dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.116484:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f106dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.117848:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff935b952e8800) 00010000:00010000:3.0:1787432784.117863:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787432784.117875:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f106dc lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.117885:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f106dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.117917:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432784.117927:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432784.117930:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787432784.280331:0:12504:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787432784.280344:0:12504:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787432784.281247:0:12504:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787432784.281256:0:12504:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787432784.439479:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432784.439612:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791843200 00000100:00100000:3.0:1787432784.439625:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791843200 00000100:00100000:3.0:1787432784.439732:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 187 00000100:00100000:3.0:1787432784.439745:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+22:11562:x1874258791843200:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432784.439782:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432784.439812:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f106e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025eae expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.440182:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f106ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.440202:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f106ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.440218:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f106ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432784.440233:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787432784.440452:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f106e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025eae expref: 25 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.440475:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f106ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025eae expref: 24 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.440486:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:3.0:1787432784.440489:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787432784.440494:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80031400, rc 0) 00000100:00100000:3.0:1787432784.440588:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+24:11562:x1874258791843200:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 845us (1122us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787432784.440605:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 187 00000100:00100000:2.0:1787432784.448880:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432784.456288:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791843328 00000100:00100000:0.0:1787432784.456309:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791843328 00000100:00100000:0.0:1787432784.456399:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 188 00000100:00100000:0.0:1787432784.456413:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+24:11562:x1874258791843328:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:0.0:1787432784.456519:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f106f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.456541:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f106f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.456868:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f106f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.456953:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f106ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.456963:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f106ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.456987:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f106ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457392:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10706 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457401:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457409:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432784.457464:0:8110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457479:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f106f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457486:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f106f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457494:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f106f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457500:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cee00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432784.457505:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f106f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457512:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f106f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457527:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:2.0:1787432784.457536:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432784.457542:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f106f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457548:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f106f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457576:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f106ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457584:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f106ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457590:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f106ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457597:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432784.457600:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f106ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457605:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f106ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457612:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff935b952e8600) 00010000:00010000:2.0:1787432784.457615:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432784.457617:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f106ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457622:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f106ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457907:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457920:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10706 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457926:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457931:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432784.457934:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457940:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10706 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457949:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b952e8900) 00010000:00010000:2.0:1787432784.457951:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432784.457955:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10706 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.457960:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10706 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432784.458090:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+24:11562:x1874258791843328:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 1675us (9221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432784.458102:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 188 00000100:00100000:3.0:1787432784.513391:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432784.513519:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791843584 00000100:00100000:0.0:1787432784.513534:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791843584 00000100:00100000:0.0:1787432784.513621:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 189 00000100:00100000:0.0:1787432784.513693:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+24:11565:x1874258791843584:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787432784.513724:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432784.513751:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f1070d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025eb5 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.513852:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10714 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.513870:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10714 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.513884:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10714 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.513902:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f1071b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.513928:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f1071b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.513936:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f1071b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.514352:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f10722 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.514362:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f10722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.514369:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f10722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432784.514381:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787432784.514523:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10714 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.514531:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10714 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.514540:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10714 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.514547:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cea00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432784.514553:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10714 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.514561:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10714 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.514587:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:0.0:1787432784.514591:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432784.514597:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10714 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.514603:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10714 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.514620:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f1071b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.514626:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f1071b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.514632:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f1071b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.514638:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cf200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432784.514641:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f1071b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.514700:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f1071b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.514709:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff935b9838fc00) 00010000:00010000:0.0:1787432784.514711:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432784.514714:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f1071b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.514720:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f1071b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.514784:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f1070d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025eb5 expref: 27 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.514800:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f10722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025eb5 expref: 26 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.514808:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838f100) 00010000:00010000:0.0:1787432784.514810:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432784.514812:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cfa00, rc 0) 00000100:00100000:0.0:1787432784.514897:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+26:11565:x1874258791843584:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1266us (1524us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1787432784.514906:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 189 00000100:00100000:0.0:1787432784.520624:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432784.520765:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791843712 00000100:00100000:3.0:1787432784.520779:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791843712 00000100:00100000:3.0:1787432784.520857:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 190 00000100:00100000:3.0:1787432784.520869:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+26:11565:x1874258791843712:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:3.0:1787432784.520966:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10730 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.520987:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.521002:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.521038:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.521046:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10730 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.521053:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10730 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.521058:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432784.521063:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10730 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.521071:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10730 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.521110:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838f100) 00010000:00010000:3.0:1787432784.521113:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432784.521119:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10730 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.521125:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030000/0xbcb9e331c3f10730 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432784.521225:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+26:11565:x1874258791843712:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 357us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432784.521234:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 190 00000100:00100000:3.0:1787432784.525796:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432784.525928:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791843968 00000100:00100000:2.0:1787432784.525945:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791843968 00000100:00100000:2.0:1787432784.526029:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:2.0:1787432784.526041:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+26:11565:x1874258791843968:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787432784.526395:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+27:11565:x1874258791843968:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 354us (616us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787432784.526422:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:2.0:1787432784.620138:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432784.620281:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791844224 00000100:00100000:1.0:1787432784.620296:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791844224 00000100:00100000:1.0:1787432784.620379:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 191 00000100:00100000:1.0:1787432784.620390:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+27:11100:x1874258791844224:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787432784.620429:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432784.620457:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10737 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025ebc expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.620608:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f1073e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.620626:0:8110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f10722 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025eb5 expref: 28 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.620724:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f1073e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.620768:0:8110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f10722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025eb5 expref: 28 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.620783:0:8110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f10722 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025eb5 expref: 28 pid: 5868 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432784.620799:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a852bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8110:1874258812810752:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787432784.620915:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb9563d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432784.626527:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432784.626779:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791844352 00000100:00100000:3.0:1787432784.626792:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791844352 00010000:00010000:3.0:1787432784.626935:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f10722 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025eb5 expref: 29 pid: 5868 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432784.626990:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 74 00000100:00100000:3.0:1787432784.627002:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+29:2376:x1874258791844352:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432784.627022:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432784.627029:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f10722 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025eb5 expref: 29 pid: 5868 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.627045:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f10722 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025eb5 expref: 29 pid: 5868 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.627074:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838f100) 00010000:00010000:3.0:1787432784.627099:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f1073e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.627110:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f1073e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.627119:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f1073e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.627144:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432784.627218:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+29:2376:x1874258791844352:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 218us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432784.627226:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 74 00010000:00010000:1.0:1787432784.628360:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f10722 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025eb5 expref: 28 pid: 5868 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432784.628387:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a852bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8110:1874258812810752:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787432784.628415:0:8110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f1073e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.628426:0:8110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f1073e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.628432:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f1073e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432784.628461:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787432784.628923:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f10737 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ebc expref: 29 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.628965:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f1073e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ebc expref: 28 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.628977:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838f100) 00010000:00010000:1.0:1787432784.628980:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787432784.628985:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e7200, rc 0) 00000100:00100000:1.0:1787432784.629061:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+28:11100:x1874258791844224:12345-192.168.202.15@tcp:101:bash.0 Request processed in 8672us (8939us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787432784.629071:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 191 00000100:00100000:3.0:1787432784.634160:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432784.634268:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791844608 00000100:00100000:1.0:1787432784.634285:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791844608 00000100:00100000:1.0:1787432784.634370:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 192 00000100:00100000:1.0:1787432784.634383:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+28:11100:x1874258791844608:12345-192.168.202.15@tcp:36:bash.0 00010000:00010000:1.0:1787432784.634816:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1074c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.634840:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1074c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.634854:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1074c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787432784.634920:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1787432784.634953:0:5869:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf5c5315 reply state 0000000085ae82e9 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1074c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432784.634963:0:5869:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787432784.635035:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1787432784.635165:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+32:11100:x1874258791844608:12345-192.168.202.15@tcp:36:bash.0 Request processed in 784us (1021us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1787432784.635173:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 192 00000020:00080000:1.0:1787432784.635180:0:5869:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1787432784.640493:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1074c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.640520:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1074c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.640530:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1074c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.640536:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6a00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432784.640542:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1074c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.640550:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1074c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.640587:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838f100) 00010000:00010000:1.0:1787432784.640590:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432784.640597:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1074c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432784.640603:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1074c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432784.641353:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432784.642007:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791844736 00000100:00100000:0.0:1787432784.642024:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791844736 00000100:00100000:0.0:1787432784.642109:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 193 00000100:00100000:0.0:1787432784.642122:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+31:11100:x1874258791844736:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787432784.642158:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432784.642184:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10753 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025ec3 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.642271:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10753 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ec3 expref: 32 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.642289:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10753 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ec3 expref: 32 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.642333:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838f100) 00010000:00010000:0.0:1787432784.642337:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787432784.642341:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cf600, rc 0) 00000100:00100000:0.0:1787432784.642431:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+32:11100:x1874258791844736:12345-192.168.202.15@tcp:101:bash.0 Request processed in 310us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432784.642439:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 193 00000100:00100000:2.0:1787432784.647315:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432784.647767:0:12109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791844864 00000100:00100000:3.0:1787432784.647781:0:12109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791844864 00000100:00100000:3.0:1787432784.647868:0:12109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:3.0:1787432784.647882:0:12109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+7:11100:x1874258791844864:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:3.0:1787432784.647909:0:12109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432784.647941:0:12109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f1075a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025eca expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432784.647984:0:12109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8a0f4e, atime: 0x6a8a0f4d, ctime: 0x6a8a0f4e, blocks: 0xb 00010000:00010000:3.0:1787432784.648015:0:12109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787432784.648021:0:12109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432784.648031:0:12109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f1075a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.15@tcp remote: 0x93816182a025eca expref: 8 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.648081:0:12109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f1075a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.15@tcp remote: 0x93816182a025eca expref: 8 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.648099:0:12109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80030000, rc 0) 00000100:00100000:3.0:1787432784.648197:0:12109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+8:11100:x1874258791844864:12345-192.168.202.15@tcp:101:bash.0 Request processed in 318us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432784.648206:0:12109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:2.0:1787432784.657955:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432784.658077:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791844992 00000100:00100000:0.0:1787432784.658092:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791844992 00002000:00010000:0.0:1787432784.658152:0:6729:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1787432784.658158:0:6729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935bba8fdf80 with x1874258791844992 ext(0->18446744073709551615) 00002000:00010000:0.0:1787432784.658175:0:6729:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff935bba8fdf80. 00000100:00100000:0.0:1787432784.658215:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:0.0:1787432784.658229:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ee8b542c-0113-490f-a721-62606ee0807f+8:2377:x1874258791844992:12345-192.168.202.15@tcp:10:bash.0 00002000:00010000:0.0:1787432784.659399:0:6729:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787432784.659412:0:6729:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787432782 -> 1787432784 00002000:00010000:0.0:1787432784.659417:0:6729:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787432781 -> 1787432781 00002000:00010000:0.0:1787432784.659420:0:6729:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787432782 -> 1787432784 00002000:00010000:0.0:1787432784.659423:0:6729:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787432784.661843:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ee8b542c-0113-490f-a721-62606ee0807f+9:2377:x1874258791844992:12345-192.168.202.15@tcp:10:bash.0 Request processed in 3599us (3885us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787432784.661864:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00002000:00010000:0.0:1787432784.661874:0:6729:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1787432784.661878:0:6729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935bba8fdf80 with x1874258791844992 ext(0->18446744073709551615) 00002000:00010000:0.0:1787432784.661894:0:6729:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff935bba8fdf80. 00000100:00100000:1.0:1787432784.824631:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432784.832788:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791845120 00000100:00100000:2.0:1787432784.832814:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791845120 00000100:00100000:2.0:1787432784.832930:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 194 00000100:00100000:2.0:1787432784.832943:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+32:11579:x1874258791845120:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:2.0:1787432784.833052:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10761 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833073:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10761 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833088:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10761 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833107:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10768 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833115:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833122:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833508:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1076f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833520:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1076f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833537:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1076f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432784.833591:0:8110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1076f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833607:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10761 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833614:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10761 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833622:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10761 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833628:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432784.833633:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10761 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833655:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10761 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833727:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:2.0:1787432784.833731:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432784.833738:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10761 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833745:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10761 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833760:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833775:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10768 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833781:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833787:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432784.833791:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833796:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10768 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833805:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff935b952e8900) 00010000:00010000:2.0:1787432784.833808:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432784.833811:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10768 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833817:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10768 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833834:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1076f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833840:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1076f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833847:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1076f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833851:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432784.833861:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1076f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833868:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1076f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833876:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838f100) 00010000:00010000:2.0:1787432784.833879:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432784.833882:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1076f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432784.833888:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f1076f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432784.834020:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+32:11579:x1874258791845120:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 1074us (9400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432784.834030:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 194 00000100:00100000:2.0:1787432784.916063:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432784.916175:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791845376 00000100:00100000:3.0:1787432784.916190:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791845376 00000100:00100000:3.0:1787432784.916277:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 195 00000100:00100000:3.0:1787432784.916290:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+32:11582:x1874258791845376:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432784.916320:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432784.916349:0:6929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f10776 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025ed1 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.916451:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1077d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.916470:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1077d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.916496:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1077d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.916517:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10784 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.916547:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.916554:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.917043:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f1078b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.917054:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f1078b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.917062:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f1078b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432784.917075:0:6929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787432784.917196:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1077d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.917204:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1077d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.917212:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1077d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.917219:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432784.917225:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1077d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.917234:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1077d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.917262:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:3.0:1787432784.917266:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432784.917271:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1077d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.917277:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f1077d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.917294:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.917300:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10784 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.917306:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10784 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.917312:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432784.917314:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10784 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.917319:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10784 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.917326:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff935b8304af00) 00010000:00010000:3.0:1787432784.917328:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432784.917331:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10784 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.917338:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10784 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.917400:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f10776 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ed1 expref: 35 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.917418:0:6929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f1078b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ed1 expref: 34 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.917426:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838f100) 00010000:00010000:3.0:1787432784.917428:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787432784.917431:0:6929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154a00, rc 0) 00000100:00100000:3.0:1787432784.917508:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+34:11582:x1874258791845376:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1220us (1460us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1787432784.917517:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 195 00000100:00100000:3.0:1787432784.923871:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432784.924115:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791845504 00000100:00100000:0.0:1787432784.924130:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791845504 00000100:00100000:0.0:1787432784.924208:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 196 00000100:00100000:0.0:1787432784.924221:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+34:11582:x1874258791845504:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:0.0:1787432784.924318:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10799 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.924340:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f1073e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ebc expref: 34 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.924352:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10799 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.924428:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f1073e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ebc expref: 34 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.924445:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f1073e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ebc expref: 34 pid: 8110 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432784.924463:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb4b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5868:1874258812810880:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787432784.924596:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2480 going to sleep for 11 seconds 00000100:00100000:0.0:1787432784.928936:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb4b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5868:1874258812810880:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787432784.928981:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10799 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432784.938016:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432784.938151:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791845760 00000100:00100000:2.0:1787432784.938166:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791845760 00000100:00100000:2.0:1787432784.938247:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:2.0:1787432784.938259:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+35:5617:x1874258791845760:12345-192.168.202.15@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787432784.938943:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+36:5617:x1874258791845760:12345-192.168.202.15@tcp:35:ldlm_bl.0 Request processed in 682us (938us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787432784.938953:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:1.0:1787432784.949044:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432784.949161:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791845888 00000100:00100000:3.0:1787432784.949176:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791845888 00010000:00010000:3.0:1787432784.949238:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f1073e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ebc expref: 36 pid: 8110 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432784.949295:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 75 00000100:00100000:3.0:1787432784.949308:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b909b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+36:2375:x1874258791845888:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432784.949330:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432784.949338:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f1073e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ebc expref: 36 pid: 8110 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.949355:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f1073e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ebc expref: 36 pid: 8110 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.949404:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f1073e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ebc expref: 36 pid: 8110 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.949423:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838f100) 00010000:00010000:3.0:1787432784.949428:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10799 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.949439:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.949448:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10799 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432784.954913:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432784.955044:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b909b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+35:2375:x1874258791845888:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 5728us (6008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432784.955060:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 75 00010000:00010000:0.0:1787432784.958763:0:5868:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.958786:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.958855:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.958864:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10799 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.958872:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.958878:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cf200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432784.958883:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.958891:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10799 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.958925:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838f100) 00010000:00010000:0.0:1787432784.958928:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787432784.958933:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10799 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432784.958940:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10799 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432784.959075:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+34:11582:x1874258791845504:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 34849us (35212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432784.959086:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 196 00000100:00100000:1.0:1787432784.962021:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432784.962159:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791846144 00000100:00100000:3.0:1787432784.962172:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791846144 00000100:00100000:3.0:1787432784.962249:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:3.0:1787432784.962262:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+34:11582:x1874258791846144:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:3.0:1787432784.962618:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+35:11582:x1874258791846144:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 356us (611us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787432784.962627:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 53 00010000:00010000:3.0:1787432785.013979:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432785.076062:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432785.076822:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791846400 00000100:00100000:2.0:1787432785.076841:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791846400 00000100:00100000:2.0:1787432785.076935:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 197 00000100:00100000:2.0:1787432785.076949:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+35:11593:x1874258791846400:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:2.0:1787432785.077006:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432785.077037:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f107a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025ed8 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.077142:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f107a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.077162:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f107a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.077175:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f107a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.077195:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f107ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.077203:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f107ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.077211:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f107ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.078291:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f107b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.078562:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f107b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.078585:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f107b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432785.078602:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1787432785.079074:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f107a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.079085:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f107a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.079093:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f107a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.079100:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432785.079105:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f107a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.079114:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f107a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.079130:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:2.0:1787432785.079133:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432785.079138:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f107a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.079145:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f107a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.079163:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f107ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.079169:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f107ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.079175:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f107ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.079179:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fa00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432785.079190:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f107ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.079195:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f107ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.079203:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff935b952e8900) 00010000:00010000:2.0:1787432785.079206:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432785.079209:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f107ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.079214:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f107ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.079280:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f107a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ed8 expref: 38 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.079297:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f107b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ed8 expref: 37 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.079386:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838f100) 00010000:00010000:2.0:1787432785.079389:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432785.079392:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5fe00, rc 0) 00000100:00100000:2.0:1787432785.079566:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+37:11593:x1874258791846400:12345-192.168.202.15@tcp:101:cat.0 Request processed in 2619us (3519us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787432785.079585:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 197 00000100:00100000:0.0:1787432785.086287:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432785.086474:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791846656 00000100:00100000:3.0:1787432785.086507:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791846656 00000100:00100000:3.0:1787432785.089990:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 54 00000100:00100000:3.0:1787432785.090009:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+37:11593:x1874258791846656:12345-192.168.202.15@tcp:35:cat.0 00000100:00100000:3.0:1787432785.090354:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+38:11593:x1874258791846656:12345-192.168.202.15@tcp:35:cat.0 Request processed in 349us (4083us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1787432785.090362:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 54 00000100:00100000:1.0:1787432785.114218:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432785.114353:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791846912 00000100:00100000:0.0:1787432785.114368:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791846912 00000100:00100000:0.0:1787432785.114471:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 198 00000100:00100000:0.0:1787432785.114487:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+38:11594:x1874258791846912:12345-192.168.202.15@tcp:36:rm.0 00010000:00010000:0.0:1787432785.114584:0:5867:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787432785.114625:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f107b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ed8 expref: 38 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.114705:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f1078b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ed1 expref: 37 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.114723:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf600/0xbcb9e331c3f10753 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ec3 expref: 36 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.114736:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838f100) 00010000:00010000:0.0:1787432785.114748:0:5867:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787432785.114781:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f107c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.114803:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f107c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.114813:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f107c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.114832:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f107ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.114839:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f107ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.114845:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f107ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.115236:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f107d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.115245:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f107d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.115251:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f107d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787432785.115986:0:5867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1787432785.116000:0:5867:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 419781341784ns, next at 420781338501ns, rc = 0 00010000:00010000:0.0:1787432785.116071:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f107d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.116083:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f107d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.116091:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f107d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.116099:0:5867:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f107d8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.116105:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f107d8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.116112:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f107d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.116138:0:5867:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787432785.116167:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f107d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.116181:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f107d1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.116187:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f107d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.116192:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cea00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432785.116198:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f107d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.116206:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f107d1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.116217:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838fa00) 00010000:00010000:0.0:1787432785.116220:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787432785.116225:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f107d1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.116230:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f107d1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.116250:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f107c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.116255:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f107c3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.116260:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f107c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.116265:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cfc00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432785.116273:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f107c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.116279:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f107c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.116286:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:0.0:1787432785.116288:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432785.116291:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f107c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.116297:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfc00/0xbcb9e331c3f107c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787432785.116307:0:5867:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000574a26bf reply state 00000000bd10451d transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f107ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432785.116317:0:5867:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787432785.116450:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+37:11594:x1874258791846912:12345-192.168.202.15@tcp:36:rm.0 Request processed in 1963us (2243us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787432785.116460:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 198 00010000:00010000:3.0:1787432785.116706:0:11210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432785.116715:0:11210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f107d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.116722:0:11210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cfa00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:3.0:1787432785.116725:0:11210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f107d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.116732:0:11210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f107d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.116743:0:11210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff935b9838fa00) 00010000:00010000:3.0:1787432785.116745:0:11210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787432785.116748:0:11210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f107d8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.116754:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f107d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.116772:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432785.116775:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432785.116777:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432785.145110:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812811136:0@lo:400:kworker.0 00000100:00100000:2.0:1787432785.145206:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432785.145271:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812811648:0@lo:400:kworker.0 00000100:00100000:2.0:1787432785.145305:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432785.145338:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787432785.145343:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812811008:0@lo:400:kworker.0 00000100:00100000:2.0:1787432785.145370:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432785.145388:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3333:1874258812811520:0@lo:400:kworker.0 00000100:00100000:2.0:1787432785.145408:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432785.145434:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812811264:0@lo:400:kworker.0 00000100:00100000:2.0:1787432785.145456:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432785.145473:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432785.145477:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812811392:0@lo:400:kworker.0 00000100:00100000:2.0:1787432785.145496:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432785.145540:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812811648 00000100:00100000:2.0:1787432785.145550:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812811648 00000100:00100000:2.0:1787432785.145610:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812811392 00000100:00100000:2.0:1787432785.145613:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812811392 00000100:00100000:2.0:1787432785.145784:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787432785.145798:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3333:x1874258812811648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432785.145862:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3333:x1874258812811648:12345-0@lo:400:kworker.0 Request processed in 68us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432785.145870:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787432785.145891:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787432785.145896:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3330:x1874258812811392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432785.145928:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3330:x1874258812811392:12345-0@lo:400:kworker.0 Request processed in 32us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432785.145934:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787432785.145955:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812811008 00000100:00100000:2.0:1787432785.145966:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812811008 00000100:00100000:2.0:1787432785.145998:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787432785.146004:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3333:x1874258812811008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432785.146035:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3333:x1874258812811008:12345-0@lo:400:kworker.0 Request processed in 31us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432785.146040:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:2.0:1787432785.146068:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787432785.146074:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432785.146113:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812811392:0@lo:400:kworker.0 00000100:00100000:2.0:1787432785.146144:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812811008:0@lo:400:kworker.0 00000100:00100000:2.0:1787432785.146153:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812811648:0@lo:400:kworker.0 00000100:00100000:2.0:1787432785.146176:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812811136 00000100:00100000:2.0:1787432785.146179:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812811136 00000100:00100000:2.0:1787432785.146204:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812811520 00000100:00100000:2.0:1787432785.146207:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812811520 00000100:00100000:2.0:1787432785.146224:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812811264 00000100:00100000:2.0:1787432785.146226:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812811264 00000100:00100000:2.0:1787432785.146238:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787432785.146244:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812811136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432785.146277:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812811136:12345-0@lo:400:kworker.0 Request processed in 33us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432785.146283:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787432785.146292:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787432785.146297:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1874258812811520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432785.146319:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1874258812811520:12345-0@lo:400:kworker.0 Request processed in 22us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432785.146335:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787432785.146344:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787432785.146348:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812811264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432785.146374:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812811264:12345-0@lo:400:kworker.0 Request processed in 26us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432785.146380:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:2.0:1787432785.146394:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432785.146408:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812811264:0@lo:400:kworker.0 00000100:00100000:2.0:1787432785.146426:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3333:1874258812811520:0@lo:400:kworker.0 00000100:00100000:2.0:1787432785.146436:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812811136:0@lo:400:kworker.0 00010000:00010000:3.0:1787432785.148195:0:3317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f107ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.148244:0:3317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f107ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.148254:0:3317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f107ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.148261:0:3317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cf200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432785.148268:0:3317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f107ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.148278:0:3317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f107ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.148310:0:3317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff935b9838fc00) 00010000:00010000:3.0:1787432785.148315:0:3317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432785.148320:0:3317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f107ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.148328:0:3317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f107ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432785.180117:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432785.180344:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791847168 00000100:00100000:2.0:1787432785.180358:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791847168 00000100:00100000:2.0:1787432785.180437:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 199 00000100:00100000:2.0:1787432785.180450:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+36:11600:x1874258791847168:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787432785.180486:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432785.180772:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f107df lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025edf expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.180960:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f107e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.180980:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f107e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.180994:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f107e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.181033:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f107ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.181041:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f107ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.181048:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f107ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787432785.182290:0:5868:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787432785.182952:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f107f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.182974:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f107f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.182987:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f107f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.183035:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f107e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.183042:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f107e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.183048:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f107e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.183054:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432785.183059:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f107e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.183084:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f107e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.183100:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:2.0:1787432785.183103:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432785.183109:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f107e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.183116:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f107e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432785.183132:0:5868:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003aee3f18 reply state 00000000bf24bca4 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f107ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432785.183142:0:5868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787432785.183188:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f107df lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025edf expref: 39 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.183205:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f107f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025edf expref: 38 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.183213:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8600) 00010000:00010000:2.0:1787432785.183215:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432785.183217:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f000, rc 0) 00000100:00100000:2.0:1787432785.183477:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+39:11600:x1874258791847168:12345-192.168.202.15@tcp:101:bash.0 Request processed in 3026us (3373us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787432785.183488:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 199 00010000:00010000:2.0:1787432785.185820:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f107ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.185860:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f107ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.185867:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f107ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.185874:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432785.185880:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f107ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.185888:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f107ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.185909:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff935b952e8900) 00010000:00010000:2.0:1787432785.185912:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432785.185917:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f107ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.185924:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f107ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432785.187491:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432785.187650:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791847296 00000100:00100000:0.0:1787432785.187691:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791847296 00000100:00100000:0.0:1787432785.187792:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:0.0:1787432785.187805:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2375:x1874258791847296:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787432785.187831:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432785.187858:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b3f6e74/0xbcb9e331c3f10802 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025ee6 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787432785.187892:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787432785.187937:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787432785.187942:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432785.187955:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b3f6e74/0xbcb9e331c3f10802 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ee6 expref: 6 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.187981:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b3f6e74/0xbcb9e331c3f10802 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ee6 expref: 6 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.187999:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cea00, rc 0) 00000100:00100000:0.0:1787432785.188084:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791847296:12345-192.168.202.15@tcp:101:bash.0 Request processed in 281us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432785.188092:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00080000:2.0:1787432785.188353:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432785.192397:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432785.192504:0:12109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791847424 00000100:00100000:2.0:1787432785.192519:0:12109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791847424 00000100:00100000:2.0:1787432785.192817:0:12109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:2.0:1787432785.192832:0:12109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+6:11600:x1874258791847424:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787432785.192856:0:12109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432785.192880:0:12109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2e03839/0xbcb9e331c3f10809 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025eed expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.192943:0:12109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b3f6e74/0xbcb9e331c3f10802 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ee6 expref: 7 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.192954:0:12109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432785.192959:0:12109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432785.192966:0:12109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e03839/0xbcb9e331c3f10809 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025eed expref: 7 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.193008:0:12109:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b3f6e74/0xbcb9e331c3f10802 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ee6 expref: 7 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.193024:0:12109:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b3f6e74/0xbcb9e331c3f10802 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ee6 expref: 7 pid: 8446 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432785.193041:0:12109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12109:1874258812811776:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432785.193152:0:12109:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b98bf4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432785.197112:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432785.197203:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791847552 00000100:00100000:3.0:1787432785.197216:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791847552 00010000:00010000:3.0:1787432785.197268:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b3f6e74/0xbcb9e331c3f10802 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ee6 expref: 8 pid: 8446 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432785.197336:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:3.0:1787432785.197349:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+8:2375:x1874258791847552:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432785.197369:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432785.197413:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b3f6e74/0xbcb9e331c3f10802 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ee6 expref: 8 pid: 8446 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.197429:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b3f6e74/0xbcb9e331c3f10802 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ee6 expref: 8 pid: 8446 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.197461:0:5851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432785.197466:0:5851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432785.197475:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2e03839/0xbcb9e331c3f10809 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025eed expref: 8 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.197487:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e03839/0xbcb9e331c3f10809 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025eed expref: 8 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.197544:0:5851:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c2e03839/0xbcb9e331c3f10809 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025eed expref: 8 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432785.197568:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a85a9ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5851:1874258812811904:192.168.202.15@tcp:105: 00000100:00100000:3.0:1787432785.197737:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b878559c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787432785.200282:0:12109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b3f6e74/0xbcb9e331c3f10802 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025ee6 expref: 8 pid: 8446 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432785.200326:0:12109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12109:1874258812811776:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787432785.200373:0:12109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c2e03839/0xbcb9e331c3f10809 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025eed expref: 7 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.200392:0:12109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e600, rc 0) 00000100:00100000:2.0:1787432785.200496:0:12109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+7:11600:x1874258791847424:12345-192.168.202.15@tcp:101:bash.0 Request processed in 7668us (8112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432785.200507:0:12109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:3.0:1787432785.203918:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a85a9ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5851:1874258812811904:192.168.202.15@tcp:105: 00010000:00010000:3.0:1787432785.203958:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432785.204028:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+6:2375:x1874258791847552:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 6680us (6929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432785.204042:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:3.0:1787432785.206984:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432785.207120:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791847808 00000100:00100000:2.0:1787432785.207133:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791847808 00000100:00100000:2.0:1787432785.207201:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:2.0:1787432785.207212:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+38:11600:x1874258791847808:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:2.0:1787432785.207746:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+39:11600:x1874258791847808:12345-192.168.202.15@tcp:35:bash.0 Request processed in 531us (775us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787432785.207755:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:1.0:1787432785.399456:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432785.399700:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791847936 00000100:00100000:2.0:1787432785.399716:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791847936 00000100:00100000:2.0:1787432785.399807:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 200 00000100:00100000:2.0:1787432785.399819:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+39:11616:x1874258791847936:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787432785.399851:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432785.399881:0:6929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10810 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025ef4 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.400011:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10817 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.400028:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.400043:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432785.400128:0:6929:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787432785.400138:0:6929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787432785.400170:0:6929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.400204:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10810 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ef4 expref: 41 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.400227:0:6929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10817 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ef4 expref: 40 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.400237:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:2.0:1787432785.400240:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787432785.400243:0:6929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e000, rc 0) 00000100:00100000:2.0:1787432785.400739:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+40:11616:x1874258791847936:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 919us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432785.400748:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 200 00000100:00100000:1.0:1787432785.408091:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432785.408240:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791848192 00000100:00100000:2.0:1787432785.408255:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791848192 00000100:00100000:2.0:1787432785.408612:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 201 00000100:00100000:2.0:1787432785.408628:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+40:11616:x1874258791848192:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787432785.408701:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432785.408735:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f1081e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025efb expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.408892:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10825 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.408911:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.408950:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432785.408968:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787432785.409424:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f1081e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025efb expref: 43 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.409451:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025efb expref: 42 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.409462:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8600) 00010000:00010000:2.0:1787432785.409465:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432785.409470:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f600, rc 0) 00000100:00100000:2.0:1787432785.409621:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+42:11616:x1874258791848192:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 996us (1546us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787432785.409631:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 201 00000100:00100000:2.0:1787432785.416807:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432785.416894:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432785.417029:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791848448 00000100:00100000:0.0:1787432785.417043:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791848448 00000100:00100000:0.0:1787432785.417126:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 202 00000100:00100000:0.0:1787432785.417138:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+42:11616:x1874258791848448:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787432785.417173:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432785.417204:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f10833 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f02 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.417348:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f1083a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.417368:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f1083a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.417406:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f1083a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432785.417424:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787432785.417630:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f10833 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f02 expref: 45 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.417696:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f1083a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f02 expref: 44 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.417707:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8600) 00010000:00010000:0.0:1787432785.417711:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787432785.417716:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cec00, rc 0) 00000100:00100000:0.0:1787432785.417807:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+44:11616:x1874258791848448:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 670us (1017us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787432785.417815:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 202 00000100:00100000:1.0:1787432785.418818:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791848576 00000100:00100000:1.0:1787432785.418833:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791848576 00000100:00100000:1.0:1787432785.418924:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:1.0:1787432785.418935:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+44:2376:x1874258791848576:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432785.418951:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432785.418976:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10825 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025efb expref: 44 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432785.418997:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8600) 00010000:00010000:1.0:1787432785.419001:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432785.419043:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+43:2376:x1874258791848576:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 109us (2148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432785.419050:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:1.0:1787432785.426057:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432785.426132:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791848704 00000100:00100000:2.0:1787432785.426146:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791848704 00000100:00100000:2.0:1787432785.426281:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:2.0:1787432785.426294:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+6:2376:x1874258791848704:12345-192.168.202.15@tcp:1:lfs.0 00010000:00010000:2.0:1787432785.426440:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a294a75b/0xbcb9e331c3f10848 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.426467:0:6725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2e03839/0xbcb9e331c3f10809 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025eed expref: 6 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.426500:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787432785.426506:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432785.426512:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a294a75b/0xbcb9e331c3f10848 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.426886:0:6725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2e03839/0xbcb9e331c3f10809 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x93816182a025eed expref: 6 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.426905:0:6725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2e03839/0xbcb9e331c3f10809 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025eed expref: 6 pid: 12109 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432785.426924:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6725:1874258812812032:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432785.427116:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b98bf4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787432785.430563:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6725:1874258812812032:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787432785.430674:0:6725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a294a75b/0xbcb9e331c3f10848 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432785.433074:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432785.433274:0:6731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791848832 00000100:00100000:3.0:1787432785.433289:0:6731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791848832 00002000:00100000:3.0:1787432785.433368:0:6731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff935a852bd880 x1874258791848832/t0(0) o4->ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp:496/0 lens 504/0 e 0 to 0 dl 1787432796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787432785.433381:0:6731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935a852bd880 with x1874258791848832 ext(0->8) 00010000:00010000:3.0:1787432785.433391:0:6731:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c2e03839/0xbcb9e331c3f10809 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025eed expref: 7 pid: 12109 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.433412:0:6731:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c2e03839/0xbcb9e331c3f10809 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025eed expref: 7 pid: 12109 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432785.433421:0:6731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff935a852bd880 00000100:00100000:3.0:1787432785.433462:0:6731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:3.0:1787432785.433474:0:6731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ee8b542c-0113-490f-a721-62606ee0807f+7:2376:x1874258791848832:12345-192.168.202.15@tcp:4:lfs.0 00000100:00100000:3.0:1787432785.434461:0:6731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ee8b542c-0113-490f-a721-62606ee0807f+9:2376:x1874258791848832:12345-192.168.202.15@tcp:4:lfs.0 Request processed in 979us (1394us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787432785.434474:0:6731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 2 00002000:00100000:3.0:1787432785.434483:0:6731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff935a852bd880 x1874258791848832/t4294967308(0) o4->ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp:496/0 lens 504/448 e 0 to 0 dl 1787432796 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787432785.434493:0:6731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935a852bd880 with x1874258791848832 ext(0->8) 00010000:00010000:3.0:1787432785.434502:0:6731:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c2e03839/0xbcb9e331c3f10809 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025eed expref: 9 pid: 12109 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.434536:0:6731:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c2e03839/0xbcb9e331c3f10809 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025eed expref: 9 pid: 12109 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432785.434545:0:6731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff935a852bd880 00000100:00100000:2.0:1787432785.439925:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432785.440070:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791848960 00000100:00100000:0.0:1787432785.440085:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791848960 00010000:00010000:0.0:1787432785.440153:0:8489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e03839/0xbcb9e331c3f10809 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025eed expref: 9 pid: 12109 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432785.440208:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00100000:0.0:1787432785.440223:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+9:2375:x1874258791848960:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432785.440244:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787432785.440270:0:8489:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787432785.440274:0:8489:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787432785 00002000:00010000:0.0:1787432785.440295:0:8489:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787432785 00002000:00010000:0.0:1787432785.440297:0:8489:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787432785 00010000:00010000:0.0:1787432785.440305:0:8489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2e03839/0xbcb9e331c3f10809 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025eed expref: 9 pid: 12109 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.440323:0:8489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2e03839/0xbcb9e331c3f10809 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025eed expref: 9 pid: 12109 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.440356:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2e03839/0xbcb9e331c3f10809 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025eed expref: 9 pid: 12109 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.440379:0:8489:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432785.440385:0:8489:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432785.440392:0:8489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a294a75b/0xbcb9e331c3f10848 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.440404:0:8489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a294a75b/0xbcb9e331c3f10848 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.440453:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432785.440533:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+8:2375:x1874258791848960:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 311us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432785.440542:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 77 00010000:00010000:2.0:1787432785.441053:0:6725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a294a75b/0xbcb9e331c3f10848 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.441065:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a294a75b/0xbcb9e331c3f10848 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.441100:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a294a75b/0xbcb9e331c3f10848 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.441110:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a294a75b/0xbcb9e331c3f10848 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.441137:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a294a75b/0xbcb9e331c3f10848 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.441146:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fa00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432785.441151:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a294a75b/0xbcb9e331c3f10848 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.441161:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a294a75b/0xbcb9e331c3f10848 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.441178:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a294a75b/0xbcb9e331c3f10848 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.441186:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a294a75b/0xbcb9e331c3f10848 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432785.441270:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+7:2376:x1874258791848704:12345-192.168.202.15@tcp:1:lfs.0 Request processed in 14976us (15221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432785.441280:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:2.0:1787432785.446883:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432785.447229:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791849216 00000100:00100000:3.0:1787432785.447243:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791849216 00000100:00100000:3.0:1787432785.447322:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:3.0:1787432785.447333:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8355f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+43:11616:x1874258791849216:12345-192.168.202.15@tcp:35:lfs.0 00000004:00010000:3.0:1787432785.447423:0:5871:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f1083a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f02 expref: 43 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787432785.447805:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787432785.447843:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1787432785.449817:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1787432785.449916:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1084f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.449939:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f107f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025edf expref: 47 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.449972:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1084f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.450262:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f107f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025edf expref: 47 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.450283:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f107f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025edf expref: 47 pid: 5868 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432785.450360:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95adc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5871:1874258812812160:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432785.450582:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b98bf4540 going to sleep for 11 seconds 00000100:00100000:1.0:1787432785.458096:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432785.458444:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791849344 00000100:00100000:3.0:1787432785.458458:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791849344 00010000:00010000:3.0:1787432785.458516:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f107f4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025edf expref: 48 pid: 5868 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432785.458580:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 78 00000100:00100000:3.0:1787432785.458592:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+48:2375:x1874258791849344:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432785.458613:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432785.458631:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f107f4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025edf expref: 48 pid: 5868 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.458701:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f107f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025edf expref: 48 pid: 5868 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.458754:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8600) 00010000:00010000:3.0:1787432785.458760:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1084f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.458772:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1084f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.458780:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1084f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.458806:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432785.458882:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+48:2375:x1874258791849344:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 292us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432785.458893:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 78 00010000:00010000:2.0:1787432785.460937:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f107f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025edf expref: 47 pid: 5868 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432785.460967:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95adc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5871:1874258812812160:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787432785.461190:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1084f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.461203:0:5871:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1084f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.461209:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1084f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787432785.461453:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787432785.462226:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1787432785.462400:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95adc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5871:1874258812812288:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787432785.462515:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432785.462581:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9087de40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432785.463007:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812812288 00000100:00100000:1.0:1787432785.463019:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812812288 00000100:00100000:1.0:1787432785.463098:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787432785.463120:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5871:x1874258812812288:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787432785.463240:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5871:x1874258812812288:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 123us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432785.463248:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787432785.463815:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95adc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5871:1874258812812288:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787432785.465025:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1787432785.465169:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a85a9d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5871:1874258812812416:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787432785.465247:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432785.465279:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87855600 going to sleep for 11 seconds 00000100:00100000:1.0:1787432785.465879:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812812416 00000100:00100000:1.0:1787432785.465892:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812812416 00000100:00100000:1.0:1787432785.465962:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787432785.465974:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5871:x1874258812812416:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787432785.466477:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5871:x1874258812812416:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 503us (1227us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787432785.466486:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787432785.466926:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a85a9d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5871:1874258812812416:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787432785.467216:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1787432785.467279:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1084f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.467292:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1084f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.467312:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1084f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.467341:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432785.467347:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1084f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.467356:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1084f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.467378:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8600) 00010000:00010000:3.0:1787432785.467381:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787432785.467387:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1084f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.467393:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f1084f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787432785.468450:0:5871:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787432785.469001:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1787432785.469193:0:5871:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 420134534591ns, next at 421134528818ns, rc = 0 00000001:00080000:1.0:1787432785.469207:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1787432785.469280:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8600) 00010000:00010000:1.0:1787432785.469285:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787432785.469299:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cec00/0xbcb9e331c3f1083a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f02 expref: 51 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432785.469484:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8355f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+50:11616:x1874258791849216:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 22151us (22621us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1787432785.469497:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 56 00000020:00080000:1.0:1787432785.469504:0:5871:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787432785.480267:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432785.480441:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791849472 00000100:00100000:2.0:1787432785.480454:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791849472 00000100:00100000:2.0:1787432785.480563:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 203 00000100:00100000:2.0:1787432785.480580:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+50:11616:x1874258791849472:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787432785.480613:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432785.480682:0:6929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10856 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f09 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.480765:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10856 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f09 expref: 51 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.480782:0:6929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10856 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f09 expref: 51 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.480804:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:2.0:1787432785.480807:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787432785.480812:0:6929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f000, rc 0) 00000100:00100000:2.0:1787432785.480890:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+51:11616:x1874258791849472:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 317us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432785.480898:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 203 00000100:00100000:0.0:1787432785.489563:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432785.491268:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791849728 00000100:00100000:3.0:1787432785.491288:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791849728 00000100:00100000:0.0:1787432785.491508:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:0.0:1787432785.491531:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+51:11616:x1874258791849728:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:0.0:1787432785.491954:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+52:11616:x1874258791849728:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 422us (2453us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1787432785.491994:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:3.0:1787432785.606116:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432785.606266:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791849856 00000100:00100000:2.0:1787432785.606279:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791849856 00000100:00100000:2.0:1787432785.606357:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 204 00000100:00100000:2.0:1787432785.606371:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+52:11626:x1874258791849856:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:2.0:1787432785.606482:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f1085d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.606522:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f1085d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.606536:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f1085d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.606566:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10864 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.606575:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.606582:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.606916:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f1086b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.606926:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f1086b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.606933:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f1086b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432785.606986:0:8110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f1086b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607002:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f1085d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607008:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f1085d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607027:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f1085d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607034:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fa00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432785.607039:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f1085d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607048:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f1085d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607063:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:2.0:1787432785.607067:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432785.607073:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f1085d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607080:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f1085d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607095:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607102:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10864 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607107:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607113:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432785.607116:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607133:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10864 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607143:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff935b952e8300) 00010000:00010000:2.0:1787432785.607145:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432785.607149:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10864 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607155:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10864 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607172:0:8110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f1086b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607178:0:8110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f1086b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607183:0:8110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f1086b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607188:0:8110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432785.607191:0:8110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f1086b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607197:0:8110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f1086b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607204:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:2.0:1787432785.607207:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432785.607210:0:8110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f1086b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.607225:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f1086b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432785.607463:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+52:11626:x1874258791849856:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 1091us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432785.607473:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 204 00000100:00100000:3.0:1787432785.647731:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432785.647966:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791850112 00000100:00100000:2.0:1787432785.647994:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791850112 00000100:00100000:2.0:1787432785.648086:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 205 00000100:00100000:2.0:1787432785.648099:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+52:11629:x1874258791850112:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787432785.648128:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432785.648156:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f10872 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f10 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.648257:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10879 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.648275:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10879 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.648290:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10879 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.648307:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10880 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.648315:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.648349:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.648529:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10887 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.648539:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.648560:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432785.648571:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787432785.648953:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10879 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.648963:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10879 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.648971:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10879 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.648978:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432785.648983:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10879 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.648991:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10879 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.649066:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:2.0:1787432785.649070:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432785.649085:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10879 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.649092:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10879 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.649107:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.649113:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10880 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.649118:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10880 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.649123:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fa00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432785.649126:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10880 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.649132:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10880 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.649140:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff935b952e8300) 00010000:00010000:2.0:1787432785.649143:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432785.649145:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10880 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.649151:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10880 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.649204:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e600/0xbcb9e331c3f10872 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f10 expref: 55 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.649230:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10887 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f10 expref: 54 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.649237:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:2.0:1787432785.649239:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432785.649241:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f600, rc 0) 00000100:00100000:2.0:1787432785.649328:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+54:11629:x1874258791850112:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1231us (1614us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787432785.649338:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 205 00000100:00100000:0.0:1787432785.654178:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812812544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432785.654280:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432785.654430:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812812544 00000100:00100000:2.0:1787432785.654439:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812812544 00000100:00100000:2.0:1787432785.654508:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787432785.654519:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3330:x1874258812812544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432785.654585:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432785.654678:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3330:x1874258812812544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432785.654687:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787432785.655181:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812812544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432785.655209:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432785.655219:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a852bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812812672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432785.655255:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432785.655348:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812812672 00000100:00100000:2.0:1787432785.655353:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812812672 00000100:00100000:2.0:1787432785.655391:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787432785.655399:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3330:x1874258812812672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432785.655415:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432785.655466:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3330:x1874258812812672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432785.655472:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787432785.656064:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432785.656195:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791850240 00000100:00100000:2.0:1787432785.656200:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791850240 00000100:00100000:2.0:1787432785.656249:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 206 00000100:00100000:2.0:1787432785.656258:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+54:11629:x1874258791850240:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:2.0:1787432785.656337:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f10895 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.656359:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f10895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.656375:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f10895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.656408:0:6929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f10895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.656415:0:6929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f10895 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.656422:0:6929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f10895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.656428:0:6929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fe00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432785.656433:0:6929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f10895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.656442:0:6929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f10895 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.656456:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:2.0:1787432785.656460:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787432785.656467:0:6929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f10895 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.656483:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f10895 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432785.656572:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+54:11629:x1874258791850240:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 315us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432785.656580:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 206 00000100:00100000:0.0:1787432785.656855:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a852bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812812672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432785.661237:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432785.661421:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791850496 00000100:00100000:1.0:1787432785.661435:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791850496 00000100:00100000:1.0:1787432785.661529:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 58 00000100:00100000:1.0:1787432785.661541:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+54:11629:x1874258791850496:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787432785.661933:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+55:11629:x1874258791850496:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 391us (708us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787432785.661958:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 58 00000100:00100000:3.0:1787432785.739949:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432785.740338:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791850752 00000100:00100000:2.0:1787432785.740353:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791850752 00000100:00100000:2.0:1787432785.740436:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 207 00000100:00100000:2.0:1787432785.740449:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+55:11639:x1874258791850752:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787432785.740483:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432785.740486:0:8110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787432785.740537:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10817 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ef4 expref: 55 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.740569:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:2.0:1787432785.740576:0:8110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432785.740593:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f1089c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f17 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.741087:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f108a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.741108:0:8110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10887 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f10 expref: 55 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.741118:0:8110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f108a3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.741183:0:8110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10887 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f10 expref: 55 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.741199:0:8110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10887 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f10 expref: 55 pid: 5867 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432785.741218:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8110:1874258812812800:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432785.741389:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9087d780 going to sleep for 11 seconds 00000100:00100000:1.0:1787432785.750892:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432785.751400:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791850880 00000100:00100000:0.0:1787432785.751413:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791850880 00010000:00010000:0.0:1787432785.751467:0:8489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10887 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f10 expref: 56 pid: 5867 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432785.751761:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 79 00000100:00100000:0.0:1787432785.751776:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+56:2375:x1874258791850880:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432785.751796:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432785.751805:0:8489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10887 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f10 expref: 56 pid: 5867 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.751822:0:8489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10887 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f10 expref: 56 pid: 5867 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.751852:0:8489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:0.0:1787432785.751859:0:8489:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f108a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.751894:0:8489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f108a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.751902:0:8489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f108a3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.751930:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432785.752088:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+56:2375:x1874258791850880:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 316us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432785.752097:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 79 00010000:00010000:1.0:1787432785.753893:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10887 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f10 expref: 55 pid: 5867 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432785.753926:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8110:1874258812812800:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787432785.753961:0:8110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f108a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432785.753973:0:8110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f108a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432785.753979:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f108a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432785.754017:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787432785.754232:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fe00/0xbcb9e331c3f1089c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f17 expref: 56 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432785.754251:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f108a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f17 expref: 55 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432785.754261:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:1.0:1787432785.754264:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787432785.754268:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5fa00, rc 0) 00000100:00100000:1.0:1787432785.754350:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+55:11639:x1874258791850752:12345-192.168.202.15@tcp:101:bash.0 Request processed in 13903us (14417us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787432785.754360:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 207 00000100:00100000:3.0:1787432785.757411:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432785.757471:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791851136 00000100:00100000:3.0:1787432785.757482:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791851136 00000100:00100000:3.0:1787432785.760305:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 208 00000100:00100000:3.0:1787432785.760337:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+55:11639:x1874258791851136:12345-192.168.202.15@tcp:36:bash.0 00010000:00010000:3.0:1787432785.761133:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.761186:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.761202:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787432785.761273:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1787432785.761301:0:5869:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b6d92e0 reply state 00000000b6f12d4e transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432785.761311:0:5869:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787432785.761948:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+58:11639:x1874258791851136:12345-192.168.202.15@tcp:36:bash.0 Request processed in 1619us (4542us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1787432785.761960:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 208 00000020:00080000:3.0:1787432785.761968:0:5869:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787432785.765866:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432785.765908:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791851264 00000100:00100000:3.0:1787432785.765921:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791851264 00010000:00010000:0.0:1787432785.766303:0:3317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.766318:0:3317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.766327:0:3317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.766333:0:3317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432785.766339:0:3317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.766348:0:3317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.766370:0:3317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:0.0:1787432785.766373:0:3317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432785.766378:0:3317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.766408:0:3317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432785.766970:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 209 00000100:00100000:3.0:1787432785.767108:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+57:11639:x1874258791851264:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:3.0:1787432785.767144:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432785.767170:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f108b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f1e expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.767285:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f108bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.767301:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f108a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f17 expref: 58 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.767328:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f108bf lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.767376:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f108a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f17 expref: 58 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.767393:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f108a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f17 expref: 58 pid: 8110 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432785.767410:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a85a9d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5868:1874258812812928:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787432785.767536:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87855f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432785.771010:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432785.771145:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791851392 00000100:00100000:1.0:1787432785.771157:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791851392 00010000:00010000:1.0:1787432785.771212:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f108a3 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f17 expref: 59 pid: 8110 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432785.771262:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 80 00000100:00100000:1.0:1787432785.771274:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+59:2376:x1874258791851392:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432785.771294:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432785.771303:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f108a3 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f17 expref: 59 pid: 8110 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432785.771319:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f108a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f17 expref: 59 pid: 8110 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432785.771349:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:1.0:1787432785.771355:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f108bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432785.771368:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f108bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432785.771377:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f108bf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432785.771402:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432785.771474:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+59:2376:x1874258791851392:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 201us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432785.771484:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 80 00010000:00010000:3.0:1787432785.773166:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f108a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f17 expref: 58 pid: 8110 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432785.773199:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a85a9d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5868:1874258812812928:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787432785.773233:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f108bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.773243:0:5868:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f108bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.773250:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f108bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432785.773314:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787432785.773320:0:5868:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432785.773347:0:5868:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f108bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.773416:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f108b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f1e expref: 58 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.773435:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f108bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f1e expref: 57 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.773444:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:3.0:1787432785.773447:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432785.773451:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155600, rc 0) 00000100:00100000:3.0:1787432785.773595:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+57:11639:x1874258791851264:12345-192.168.202.15@tcp:101:bash.0 Request processed in 6612us (7743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432785.773605:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 209 00000100:00100000:0.0:1787432785.778456:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432785.778719:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791851648 00000100:00100000:1.0:1787432785.778752:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791851648 00000100:00100000:1.0:1787432785.778823:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:1.0:1787432785.778836:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+57:11639:x1874258791851648:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:1.0:1787432785.779175:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+58:11639:x1874258791851648:12345-192.168.202.15@tcp:35:bash.0 Request processed in 339us (731us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1787432785.779184:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:0.0:1787432785.876392:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432785.876500:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791851776 00000100:00100000:1.0:1787432785.876514:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791851776 00000100:00100000:1.0:1787432785.876606:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 210 00000100:00100000:1.0:1787432785.876627:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+58:11645:x1874258791851776:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787432785.876699:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432785.876727:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f108c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f25 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432785.876811:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f108cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432785.876828:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f108cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432785.876841:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f108cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432785.876919:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787432785.876923:0:8110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787432785.876950:0:8110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f108cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432785.876981:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f108c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f25 expref: 60 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432785.877026:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f108cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f25 expref: 59 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432785.877036:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:1.0:1787432785.877040:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787432785.877044:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e6600, rc 0) 00000100:00100000:1.0:1787432785.877121:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+59:11645:x1874258791851776:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 503us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432785.877129:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 210 00000100:00100000:2.0:1787432785.879856:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432785.880013:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791851904 00000100:00100000:3.0:1787432785.880027:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791851904 00000100:00100000:3.0:1787432785.880105:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 211 00000100:00100000:3.0:1787432785.880117:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+59:11645:x1874258791851904:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432785.880142:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432785.880171:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f108d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f2c expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.880251:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f108db lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.880269:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f108db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.880281:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f108db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.880312:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.880320:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.880326:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.880456:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.880464:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.880470:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432785.880509:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787432785.880523:0:5869:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432785.880547:0:5869:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.880560:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.880569:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f108db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.880575:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f108db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.880595:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f108db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.880602:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432785.880607:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f108db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.880616:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f108db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.880641:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:3.0:1787432785.880645:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432785.880650:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f108db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.881022:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f108db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.881043:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.881050:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.881056:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.881061:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432785.881064:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.881081:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.881091:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff935b8304af00) 00010000:00010000:3.0:1787432785.881093:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432785.881096:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.881102:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.881141:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f108d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f2c expref: 61 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.881154:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f2c expref: 60 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.881162:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:3.0:1787432785.881164:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432785.881166:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154000, rc 0) 00000100:00100000:3.0:1787432785.881279:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+60:11645:x1874258791851904:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1163us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432785.881287:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 211 00000100:00100000:0.0:1787432785.896081:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432785.896253:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791852160 00000100:00100000:3.0:1787432785.896266:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791852160 00000100:00100000:3.0:1787432785.896345:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 212 00000100:00100000:3.0:1787432785.896358:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+60:11645:x1874258791852160:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432785.896412:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432785.896441:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f108f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f33 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.896611:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.896641:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f108bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f1e expref: 61 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.896651:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f2c expref: 61 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.896696:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108f7 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.896747:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f2c expref: 61 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.896764:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f2c expref: 61 pid: 5869 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432785.896781:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a85a9d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5868:1874258812813056:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787432785.896922:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f108bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f1e expref: 61 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432785.896932:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f108bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f1e expref: 61 pid: 5868 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432785.896957:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a85a9d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5868:1874258812813184:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787432785.897364:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87855f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432785.905068:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432785.905167:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432785.905221:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791852288 00000100:00100000:0.0:1787432785.905234:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791852288 00010000:00010000:0.0:1787432785.905295:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f2c expref: 62 pid: 5869 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432785.905336:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791852416 00000100:00100000:0.0:1787432785.905339:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791852416 00010000:00010000:0.0:1787432785.905358:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f108bf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f1e expref: 63 pid: 5868 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432785.905384:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:0.0:1787432785.905396:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b909b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+63:2375:x1874258791852288:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432785.905417:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432785.905427:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f2c expref: 63 pid: 5869 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.905444:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f2c expref: 63 pid: 5869 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.905499:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:0.0:1787432785.905506:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.905528:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.905536:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432785.905627:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b909b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+63:2375:x1874258791852288:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 232us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432785.905643:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:0.0:1787432785.905738:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 82 00000100:00100000:0.0:1787432785.905745:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+62:2375:x1874258791852416:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432785.905753:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432785.905759:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f108bf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f1e expref: 62 pid: 5868 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.905769:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f108bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f1e expref: 62 pid: 5868 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.905781:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:0.0:1787432785.905784:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.905794:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.905828:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108f7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.905852:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432785.905873:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+62:2375:x1874258791852416:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 128us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432785.905880:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 82 00010000:00010000:2.0:1787432785.906163:0:5868:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.15@tcp) returned -22 from blocking AST (req@00000000a83949b4 x1874258812813056) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108e9 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f2c expref: 61 pid: 5869 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.906179:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f108e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f2c expref: 61 pid: 5869 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432785.906197:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a85a9d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5868:1874258812813056:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787432785.906212:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f108bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f1e expref: 60 pid: 5868 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432785.906222:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a85a9d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5868:1874258812813184:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787432785.906248:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:2.0:1787432785.906255:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.906265:0:5868:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.906280:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432785.906305:0:5868:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787432785.906505:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f108f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f33 expref: 61 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.906522:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f33 expref: 60 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.906531:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:2.0:1787432785.906534:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787432785.906536:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155200, rc 0) 00000100:00100000:2.0:1787432785.906588:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+60:11645:x1874258791852160:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 10231us (10522us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787432785.906595:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 212 00000100:00100000:0.0:1787432785.921399:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432785.921486:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791852672 00000100:00100000:2.0:1787432785.921501:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791852672 00000100:00100000:2.0:1787432785.921588:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:2.0:1787432785.921603:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+60:11645:x1874258791852672:12345-192.168.202.15@tcp:103:lfs.0 00010000:00010000:2.0:1787432785.921625:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432785.921719:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10856 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f09 expref: 60 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.921743:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:2.0:1787432785.921750:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432785.921849:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+59:11645:x1874258791852672:12345-192.168.202.15@tcp:103:lfs.0 Request processed in 250us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432785.921857:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:0.0:1787432785.929653:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432785.929793:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791852800 00000100:00100000:2.0:1787432785.929807:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791852800 00000100:00100000:2.0:1787432785.929885:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 213 00000100:00100000:2.0:1787432785.929899:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+59:11645:x1874258791852800:12345-192.168.202.15@tcp:58:lfs.0 00010000:00010000:2.0:1787432785.930072:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10905 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.930094:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10905 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432785.930109:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10905 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787432785.930373:0:6929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787432785.930477:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+59:11645:x1874258791852800:12345-192.168.202.15@tcp:58:lfs.0 Request processed in 580us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432785.930485:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 213 00000100:00100000:3.0:1787432785.933579:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432785.937395:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791852928 00000100:00100000:0.0:1787432785.937422:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791852928 00000100:00100000:0.0:1787432785.937582:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 214 00000100:00100000:0.0:1787432785.937597:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+59:11645:x1874258791852928:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787432785.937641:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432785.937700:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f1090c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f3a expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.937789:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10905 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.937803:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f1090c lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f3a expref: 60 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.937829:0:5869:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10905 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.937845:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f1090c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f3a expref: 60 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.937888:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:0.0:1787432785.937892:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787432785.937896:0:5869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f1090c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f3a expref: 60 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432785.937905:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cfe00, rc 0) 00000100:00100000:0.0:1787432785.938016:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+60:11645:x1874258791852928:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 421us (4453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432785.938025:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 214 00010000:00010000:3.0:1787432786.038730:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787432786.166526:0:11725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787432786.166539:0:11725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787432786.166607:0:11725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787432786.166643:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787432786.166846:0:11725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a85a9ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11725:1874258812813312:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787432786.167051:0:11725:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87855e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432786.176815:0:11725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a85a9ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11725:1874258812813312:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787432786.182972:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432786.183539:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791853056 00000100:00100000:3.0:1787432786.183561:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791853056 00000100:00100000:3.0:1787432786.183732:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 215 00000100:00100000:3.0:1787432786.183746:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+60:11646:x1874258791853056:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787432786.183793:0:5868:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787432786.183936:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+60:11646:x1874258791853056:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 192us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432786.183946:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 215 00000100:00080000:2.0:1787432786.184422:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432786.187825:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432786.187921:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791853184 00000100:00100000:0.0:1787432786.187935:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791853184 00000100:00100000:0.0:1787432786.188014:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 216 00000100:00100000:0.0:1787432786.188026:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+60:11646:x1874258791853184:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787432786.188124:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10913 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188144:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10913 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188159:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10913 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188175:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1091a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188183:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1091a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188210:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1091a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188240:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10921 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188249:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188256:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432786.188301:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787432786.188305:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787432786.188320:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188333:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10913 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188340:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10913 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188347:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10913 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188354:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1ce400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432786.188359:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10913 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188367:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10913 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188386:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff935b8304a100) 00010000:00010000:0.0:1787432786.188389:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432786.188394:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10913 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188401:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10913 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188415:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1091a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188421:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1091a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188427:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1091a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188433:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1ce600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432786.188436:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1091a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188442:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1091a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188447:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff935b9838f600) 00010000:00010000:0.0:1787432786.188449:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432786.188452:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1091a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188457:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1091a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188480:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188486:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10921 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188491:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188496:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cf000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432786.188499:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188505:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10921 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188512:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:0.0:1787432786.188515:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432786.188518:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10921 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.188525:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10921 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432786.188619:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+60:11646:x1874258791853184:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 Request processed in 594us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432786.188638:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 216 00000100:00100000:1.0:1787432786.198909:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432786.199040:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791853440 00000100:00100000:0.0:1787432786.199055:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791853440 00000100:00100000:0.0:1787432786.199136:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 217 00000100:00100000:0.0:1787432786.199168:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+60:11646:x1874258791853440:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432786.199199:0:5869:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432786.199227:0:5869:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10928 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f41 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.199387:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1092f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.199406:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1092f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.199419:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1092f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432786.199433:0:5869:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787432786.199587:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1092f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.199596:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1092f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.199604:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1092f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.199839:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1ce600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432786.199846:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1092f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.199856:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1092f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.199872:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:0.0:1787432786.199883:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787432786.199889:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1092f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.199896:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1092f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.199952:0:5869:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10928 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f41 expref: 62 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.199962:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff935b8304a100) 00010000:00010000:0.0:1787432786.199965:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787432786.199969:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f10928 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f41 expref: 62 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.199980:0:5869:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cf000, rc 0) 00000100:00100000:0.0:1787432786.200066:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+61:11646:x1874258791853440:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 900us (1172us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1787432786.200074:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 217 00000100:00100000:3.0:1787432786.207636:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432786.207804:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791853568 00000100:00100000:0.0:1787432786.207818:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791853568 00000100:00100000:0.0:1787432786.207902:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 218 00000100:00100000:0.0:1787432786.207915:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+61:11646:x1874258791853568:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787432786.207967:0:6929:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787432786.208105:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+61:11646:x1874258791853568:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 193us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432786.208114:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 218 00000100:00100000:1.0:1787432786.215176:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432786.215653:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791853824 00000100:00100000:3.0:1787432786.215706:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791853824 00000100:00100000:3.0:1787432786.215783:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 219 00000100:00100000:3.0:1787432786.215795:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+61:11646:x1874258791853824:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432786.215846:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432786.215850:0:8110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787432786.215888:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6600/0xbcb9e331c3f108cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f25 expref: 61 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.215912:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:3.0:1787432786.215918:0:8110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432786.215936:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1093d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f48 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787432786.216492:0:8110:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1787432786.216827:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10944 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.216843:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.216854:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.216919:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154600/0xbcb9e331c3f1093d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f48 expref: 63 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.216938:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10944 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f48 expref: 62 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.216948:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff935b8304af00) 00010000:00010000:3.0:1787432786.216952:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432786.216966:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154a00, rc 0) 00000100:00100000:3.0:1787432786.217052:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+62:11646:x1874258791853824:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 1258us (1890us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787432786.217061:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 219 00000100:00100000:1.0:1787432786.222339:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432786.222722:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791854080 00000100:00100000:3.0:1787432786.222738:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791854080 00000100:00100000:3.0:1787432786.222821:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 220 00000100:00100000:3.0:1787432786.222836:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+62:11646:x1874258791854080:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787432786.224773:0:5868:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432786.224820:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f10944 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f48 expref: 62 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.224843:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff935b8304af00) 00010000:00010000:3.0:1787432786.224856:0:5868:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432786.225423:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10952 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.225446:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10952 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.225464:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10952 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.225487:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10959 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x99073084 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.225493:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10959 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x99073084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.225498:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10959 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x99073084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.226185:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10952 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.226194:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10952 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.226200:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10952 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.226206:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432786.226211:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10952 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.226218:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10952 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.226234:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:3.0:1787432786.226238:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432786.226243:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10952 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.226248:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10952 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.226265:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10959 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x99073084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.226271:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10959 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x99073084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.226276:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10959 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x99073084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.226295:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432786.226298:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10959 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x99073084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.226303:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10959 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x99073084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.226312:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x99073084 (ffff935b8304a300) 00010000:00010000:3.0:1787432786.226315:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432786.226374:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10959 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x99073084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.226384:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10959 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x99073084 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432786.226535:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+61:11646:x1874258791854080:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 3698us (4205us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787432786.226609:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 220 00000100:00100000:1.0:1787432786.232392:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432786.233242:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791854208 00000100:00100000:3.0:1787432786.233258:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791854208 00000100:00100000:3.0:1787432786.233349:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 221 00000100:00100000:3.0:1787432786.233363:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+61:11646:x1874258791854208:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432786.233393:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432786.233428:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10960 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f4f expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.233475:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10967 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.233518:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.233533:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.233980:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10960 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f4f expref: 63 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.234004:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10967 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f4f expref: 62 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.234015:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff935b8304a300) 00010000:00010000:3.0:1787432786.234018:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787432786.234022:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154800, rc 0) 00000100:00100000:3.0:1787432786.234233:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+62:11646:x1874258791854208:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 871us (1856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432786.234241:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 221 00000100:00100000:1.0:1787432786.240014:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432786.240151:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791854464 00000100:00100000:0.0:1787432786.240190:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791854464 00000100:00100000:0.0:1787432786.240277:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 222 00000100:00100000:0.0:1787432786.240291:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a852bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+62:11646:x1874258791854464:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787432786.240417:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f1096e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.240439:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f1096e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.240452:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f1096e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787432786.240851:0:5869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1787432786.240864:0:5869:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 420906205620ns, next at 421906202427ns, rc = 0 00000004:00010000:0.0:1787432786.240984:0:5869:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000230af0c3 reply state 000000000a22b1cd transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f1096e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432786.240997:0:5869:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787432786.241123:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a852bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+64:11646:x1874258791854464:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 832us (1125us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1787432786.241132:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 222 00010000:00010000:2.0:1787432786.246823:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f1096e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.246847:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f1096e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.246856:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f1096e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.246884:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cf000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432786.246891:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f1096e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.246900:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f1096e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.246921:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff935b8304a300) 00010000:00010000:2.0:1787432786.246924:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787432786.246930:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f1096e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.246937:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf000/0xbcb9e331c3f1096e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432786.248819:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432786.248969:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791854592 00000100:00100000:3.0:1787432786.248985:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791854592 00000100:00100000:3.0:1787432786.249064:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 223 00000100:00100000:3.0:1787432786.249077:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+63:11646:x1874258791854592:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432786.249111:0:5868:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432786.249137:0:5868:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10975 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f56 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.249218:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10975 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f56 expref: 64 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.249253:0:5868:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10975 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f56 expref: 64 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.249279:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff935b8304a300) 00010000:00010000:3.0:1787432786.249282:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787432786.249287:0:5868:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155600, rc 0) 00000100:00100000:3.0:1787432786.249372:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+64:11646:x1874258791854592:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 298us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432786.249381:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 223 00000100:00100000:1.0:1787432786.252431:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432786.252582:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791854720 00000100:00100000:3.0:1787432786.252595:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791854720 00000100:00100000:3.0:1787432786.252746:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:3.0:1787432786.252760:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8b542c-0113-490f-a721-62606ee0807f+9:2375:x1874258791854720:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787432786.253292:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432786.254467:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8b542c-0113-490f-a721-62606ee0807f+10:2375:x1874258791854720:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 1690us (2032us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1787432786.254482:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:2.0:1787432786.257857:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432786.257980:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791854976 00000100:00100000:1.0:1787432786.257993:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791854976 00000100:00100000:1.0:1787432786.258073:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:1.0:1787432786.258085:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+64:11646:x1874258791854976:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787432786.258776:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+65:11646:x1874258791854976:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 689us (929us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787432786.258807:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:3.0:1787432786.269845:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432786.269962:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791855232 00000100:00100000:0.0:1787432786.269976:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791855232 00000100:00100000:0.0:1787432786.270051:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 224 00000100:00100000:0.0:1787432786.270065:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+65:11646:x1874258791855232:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787432786.270231:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+65:11646:x1874258791855232:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 168us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432786.270241:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 224 00000100:00100000:2.0:1787432786.273093:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432786.273336:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791855360 00000100:00100000:0.0:1787432786.273365:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791855360 00000100:00100000:0.0:1787432786.273452:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 225 00000100:00100000:0.0:1787432786.273464:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+65:11646:x1874258791855360:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432786.273490:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432786.273516:0:6929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1097c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f5d expref: -99 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.273640:0:6929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10983 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.273707:0:6929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.273720:0:6929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432786.273768:0:6929:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787432786.273791:0:6929:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.273824:0:6929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce600/0xbcb9e331c3f1097c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f5d expref: 67 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.273844:0:6929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10983 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f5d expref: 66 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.273854:0:6929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff935b8304a300) 00010000:00010000:0.0:1787432786.273857:0:6929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787432786.273861:0:6929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1ce400, rc 0) 00000100:00100000:0.0:1787432786.273934:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+66:11646:x1874258791855360:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 472us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432786.273949:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 225 00000100:00100000:2.0:1787432786.279895:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432786.280246:0:12109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791855488 00000100:00100000:3.0:1787432786.280258:0:12109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791855488 00000100:00100000:3.0:1787432786.280332:0:12109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 64 00000100:00100000:3.0:1787432786.280344:0:12109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+10:2378:x1874258791855488:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432786.280364:0:12109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432786.280388:0:12109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d83dfece/0xbcb9e331c3f1098a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f64 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432786.280418:0:12109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a0f52, blocks: 0x1 00010000:00010000:3.0:1787432786.280437:0:12109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787432786.280442:0:12109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432786.280466:0:12109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d83dfece/0xbcb9e331c3f1098a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f64 expref: 11 pid: 12109 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.280487:0:12109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d83dfece/0xbcb9e331c3f1098a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f64 expref: 11 pid: 12109 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.280501:0:12109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154a00, rc 0) 00000100:00100000:3.0:1787432786.280566:0:12109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+11:2378:x1874258791855488:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 223us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432786.280573:0:12109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 64 00000100:00100000:1.0:1787432786.288371:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432786.288495:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791855744 00000100:00100000:3.0:1787432786.288508:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791855744 00000100:00100000:3.0:1787432786.288586:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 226 00000100:00100000:3.0:1787432786.288598:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbae59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+66:11646:x1874258791855744:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787432786.288785:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbae59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+66:11646:x1874258791855744:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 188us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432786.288793:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 226 00000100:00100000:2.0:1787432786.300089:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432786.300392:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791855872 00000100:00100000:3.0:1787432786.300404:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791855872 00000100:00100000:3.0:1787432786.300474:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 65 00000100:00100000:3.0:1787432786.300487:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+11:11646:x1874258791855872:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432786.300508:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432786.300533:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f10991 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f6b expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.300567:0:6725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d83dfece/0xbcb9e331c3f1098a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f64 expref: 12 pid: 12109 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.300591:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432786.300595:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432786.300601:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f10991 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f6b expref: 12 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.301327:0:6725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d83dfece/0xbcb9e331c3f1098a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f64 expref: 12 pid: 12109 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.301344:0:6725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d83dfece/0xbcb9e331c3f1098a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f64 expref: 12 pid: 12109 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432786.301358:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a85a9d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6725:1874258812813440:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432786.301702:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87855cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432786.305880:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432786.306042:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791856000 00000100:00100000:1.0:1787432786.306052:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791856000 00010000:00010000:1.0:1787432786.306100:0:5852:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d83dfece/0xbcb9e331c3f1098a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f64 expref: 13 pid: 12109 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432786.306155:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 83 00000100:00100000:1.0:1787432786.306165:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+13:2376:x1874258791856000:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432786.306182:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432786.306206:0:5852:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d83dfece/0xbcb9e331c3f1098a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f64 expref: 13 pid: 12109 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.306221:0:5852:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d83dfece/0xbcb9e331c3f1098a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f64 expref: 13 pid: 12109 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.306246:0:5852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432786.306250:0:5852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787432786.306259:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f10991 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f6b expref: 13 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.306270:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f10991 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f6b expref: 13 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.306309:0:5852:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f10991 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f6b expref: 13 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432786.306337:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5852:1874258812813568:192.168.202.15@tcp:105: 00000100:00100000:1.0:1787432786.306431:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb9563540 going to sleep for 11 seconds 00010000:00010000:0.0:1787432786.306726:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d83dfece/0xbcb9e331c3f1098a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f64 expref: 13 pid: 12109 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432786.306742:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a85a9d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6725:1874258812813440:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787432786.306771:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f10991 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025f6b expref: 12 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.306783:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154600, rc 0) 00000100:00100000:0.0:1787432786.306816:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+12:11646:x1874258791855872:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 6333us (6739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432786.306826:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 65 00000100:00100000:1.0:1787432786.320427:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432786.320821:0:6729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791856128 00000100:00100000:3.0:1787432786.320839:0:6729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791856128 00002000:00100000:3.0:1787432786.320922:0:6729:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff935bb9fd1f80 x1874258791856128/t0(0) o4->ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp:497/0 lens 504/0 e 0 to 0 dl 1787432797 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787432786.320936:0:6729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935bb9fd1f80 with x1874258791856128 ext(0->12) 00002000:00010000:3.0:1787432786.320944:0:6729:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff935bb9fd1f80 00000100:00100000:0.0:1787432786.321110:0:6729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:0.0:1787432786.321125:0:6729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ee8b542c-0113-490f-a721-62606ee0807f+12:2376:x1874258791856128:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787432786.322016:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5852:1874258812813568:192.168.202.15@tcp:105: 00000100:00100000:0.0:1787432786.322036:0:6729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ee8b542c-0113-490f-a721-62606ee0807f+14:2376:x1874258791856128:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 Request processed in 907us (1613us total) trans 4294967320 rc 0/0 00010000:00010000:2.0:1787432786.322058:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432786.322061:0:6729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00002000:00100000:0.0:1787432786.322077:0:6729:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff935bb9fd1f80 x1874258791856128/t4294967320(0) o4->ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp:497/0 lens 504/448 e 0 to 0 dl 1787432797 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787432786.322087:0:6729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935bb9fd1f80 with x1874258791856128 ext(0->12) 00002000:00010000:0.0:1787432786.322093:0:6729:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff935bb9fd1f80 00000100:00100000:2.0:1787432786.322142:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee8b542c-0113-490f-a721-62606ee0807f+13:2376:x1874258791856000:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 15974us (16270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432786.322156:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 83 00000100:00100000:3.0:1787432786.327485:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432786.330493:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791856256 00000100:00100000:0.0:1787432786.330513:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791856256 00000100:00100000:0.0:1787432786.330651:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 227 00000100:00100000:0.0:1787432786.330708:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+66:11646:x1874258791856256:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787432786.468341:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:2.0:1787432786.468362:0:5889:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:2.0:1787432786.468396:0:5889:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000001:00080000:2.0:1787432786.468408:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1787432786.468424:0:5889:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:2.0:1787432786.469014:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812813696:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787432786.472735:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432786.473928:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812813696 00000100:00100000:2.0:1787432786.473941:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812813696 00000100:00100000:0.0:1787432786.474582:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432786.474607:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb4b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812813952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787432786.474730:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432786.474860:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787432786.474872:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb4b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812813824:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787432786.475294:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812813952 00000100:00100000:2.0:1787432786.475302:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812813952 00000100:00100000:1.0:1787432786.475418:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432786.475581:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+50:11646:x1874258791856256:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 Request processed in 144873us (148111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432786.475593:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 227 00000100:00100000:2.0:1787432786.476321:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812813824 00000100:00100000:2.0:1787432786.476330:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812813824 00000100:00100000:0.0:1787432786.476331:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787432786.476343:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3332:x1874258812813696:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787432786.476360:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787432786.476367:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3331:x1874258812813952:12345-0@lo:2:osp-syn-1-0.0 00002000:00080000:0.0:1787432786.476379:0:6725:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1787432786.476419:0:6725:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8a0f51, atime: 0x6a8a0f51, ctime: 0x6a8a0f51, blocks: 0x1 00010000:00010000:0.0:1787432786.476428:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000804856a3/0xbcb9e331c3f10998 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.476449:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=421s v=(0 0) 00010000:00010000:0.0:1787432786.476454:0:6725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432786.476462:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000804856a3/0xbcb9e331c3f10998 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.476495:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000804856a3/0xbcb9e331c3f10998 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.476507:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000804856a3/0xbcb9e331c3f10998 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.476556:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000804856a3/0xbcb9e331c3f10998 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.476587:0:6725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787432786.477439:0:6724:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787432786.477447:0:6724:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787432786 00002000:00010000:2.0:1787432786.477450:0:6724:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787432786.477453:0:6724:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787432786 -> 1787432786 00002000:00010000:2.0:1787432786.477455:0:6724:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787432786.477554:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3331:x1874258812813952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1183us (2819us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787432786.477807:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787432786.477857:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787432786.477869:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3332:x1874258812813824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787432786.477902:0:6724:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1787432786.478150:0:5855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432786.478161:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000804856a3/0xbcb9e331c3f10998 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.478174:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cf400 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432786.478180:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000804856a3/0xbcb9e331c3f10998 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.478191:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000804856a3/0xbcb9e331c3f10998 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.478207:0:6724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a633547/0xbcb9e331c3f1099f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.478216:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000804856a3/0xbcb9e331c3f10998 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.478224:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000804856a3/0xbcb9e331c3f10998 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.478226:0:6724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f1075a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.15@tcp remote: 0x93816182a025eca expref: 12 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.478235:0:6724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787432786.478240:0:6724:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432786.478244:0:6724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a633547/0xbcb9e331c3f1099f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.478251:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432786.478252:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432786.478254:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432786.478289:0:6724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f1075a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.15@tcp remote: 0x93816182a025eca expref: 12 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.478308:0:6724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f1075a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.15@tcp remote: 0x93816182a025eca expref: 12 pid: 12109 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432786.478325:0:6724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6724:1874258812814080:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432786.478420:0:6724:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87b6f180 going to sleep for 11 seconds 00000004:00080000:2.0:1787432786.478514:0:3331:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff935bbb4b3800/2, rc 0, transno 4294967321 00000100:00100000:2.0:1787432786.478521:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb4b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812813952:0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1787432786.478760:0:5889:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff935b91a23300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1787432786.478765:0:5889:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff935bba1c6a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff935b91a23000 00000020:00080000:2.0:1787432786.478769:0:5889:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff935bba1c6000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff935b90701000 00000020:00080000:2.0:1787432786.478790:0:5889:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1787432786.478813:0:5889:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff935b87855840 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1787432786.478816:0:5889:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff935bb7ad6500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff935b87855240 00000020:00080000:2.0:1787432786.478818:0:5889:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff935bb7ad6300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff935bb9581000 00000020:00080000:2.0:1787432786.478854:0:5900:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:0.0:1787432786.478985:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3332:x1874258812813696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2642us (6261us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787432786.478995:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1787432786.479040:0:3332:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff935bb95ad880/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787432786.479046:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812813696:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1787432786.479341:0:5900:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787432786.480468:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432786.480572:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791856384 00000100:00100000:0.0:1787432786.480581:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791856384 00000100:00100000:0.0:1787432786.480761:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:0.0:1787432786.480774:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+13:2375:x1874258791856384:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787432786.483480:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432786.483688:0:6724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6724:1874258812814080:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787432786.483737:0:6724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001a633547/0xbcb9e331c3f1099f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432786.483997:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791856512 00000100:00100000:3.0:1787432786.484007:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791856512 00010000:00010000:3.0:1787432786.484068:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f1075a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.15@tcp remote: 0x93816182a025eca expref: 14 pid: 12109 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432786.484429:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00100000:0.0:1787432786.484444:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+14:2376:x1874258791856512:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432786.484464:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432786.484472:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f1075a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.15@tcp remote: 0x93816182a025eca expref: 14 pid: 12109 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.484487:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f1075a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.15@tcp remote: 0x93816182a025eca expref: 14 pid: 12109 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.484534:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f1075a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.15@tcp remote: 0x93816182a025eca expref: 14 pid: 12109 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.484575:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432786.484581:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787432786.484588:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001a633547/0xbcb9e331c3f1099f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.484600:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a633547/0xbcb9e331c3f1099f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.484644:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432786.484741:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+13:2376:x1874258791856512:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 301us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432786.484750:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 84 00010000:00010000:2.0:1787432786.484920:0:6724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001a633547/0xbcb9e331c3f1099f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.484931:0:6724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a633547/0xbcb9e331c3f1099f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.484942:0:6724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a633547/0xbcb9e331c3f1099f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.484950:0:6724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a633547/0xbcb9e331c3f1099f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.484980:0:6724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787432786.487794:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3332:x1874258812813824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9918us (12364us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787432786.487811:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:2.0:1787432786.488143:0:11210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432786.488155:0:11210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a633547/0xbcb9e331c3f1099f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.488170:0:11210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e000 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432786.488176:0:11210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a633547/0xbcb9e331c3f1099f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.488188:0:11210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a633547/0xbcb9e331c3f1099f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.488216:0:11210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a633547/0xbcb9e331c3f1099f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.488224:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a633547/0xbcb9e331c3f1099f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.488258:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432786.488260:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432786.488262:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787432786.489103:0:3332:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff935bbb4b3480/2, rc 0, transno 4294967322 00000100:00100000:0.0:1787432786.489119:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb4b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812813824:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1787432786.514608:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:1.0:1787432786.514693:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:1.0:1787432786.514703:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:0.0:1787432786.515527:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+7:2375:x1874258791856384:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 Request processed in 34743us (35053us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432786.515553:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:0.0:1787432786.525127:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432786.525296:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791856768 00000100:00100000:3.0:1787432786.525311:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791856768 00000100:00100000:3.0:1787432786.525398:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 228 00000100:00100000:3.0:1787432786.525410:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+20:11646:x1874258791856768:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787432786.525485:0:5868:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432786.525873:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce400/0xbcb9e331c3f10983 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f5d expref: 20 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.525992:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff935b8304a300) 00010000:00010000:3.0:1787432786.525999:0:5868:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432786.526041:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.526121:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.526135:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432786.526464:0:5868:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003bbc32a3 reply state 000000008f5c1fd9 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432786.526475:0:5868:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787432786.531323:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+21:11646:x1874258791856768:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 5893us (6193us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787432786.531362:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 228 00000100:00100000:2.0:1787432786.545490:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:0.0:1787432786.545639:0:3317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.545698:0:3317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.545708:0:3317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.545739:0:3317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432786.545745:0:3317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.545754:0:3317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.545779:0:3317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff935b8304a300) 00010000:00010000:0.0:1787432786.545783:0:3317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432786.545789:0:3317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.545795:0:3317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432786.545967:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791856896 00000100:00100000:1.0:1787432786.545981:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791856896 00000100:00100000:1.0:1787432786.546056:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 70 00000100:00100000:1.0:1787432786.546068:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+7:2376:x1874258791856896:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787432786.546375:0:6725:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787432786.546379:0:6725:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787432786 -> 1787432785 00002000:00010000:1.0:1787432786.546382:0:6725:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787432785 00002000:00010000:1.0:1787432786.546384:0:6725:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787432786 -> 1787432785 00002000:00010000:1.0:1787432786.546386:0:6725:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787432786.546471:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+8:2376:x1874258791856896:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 404us (997us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787432786.546480:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 70 00000100:00100000:1.0:1787432786.557026:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432786.557163:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791857152 00000100:00100000:0.0:1787432786.557178:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791857152 00000100:00100000:0.0:1787432786.557258:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 229 00000100:00100000:0.0:1787432786.557272:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+20:11646:x1874258791857152:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787432786.557370:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f109ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.557392:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10967 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f4f expref: 20 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.557404:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f109ad lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.557449:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10967 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f4f expref: 20 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.557486:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10967 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f4f expref: 20 pid: 5867 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432786.557504:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb4b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5867:1874258812814208:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787432786.557639:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba81a000 going to sleep for 11 seconds 00000100:00100000:0.0:1787432786.566206:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432786.566458:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791857280 00000100:00100000:2.0:1787432786.566471:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791857280 00010000:00010000:2.0:1787432786.566531:0:8489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10967 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f4f expref: 21 pid: 5867 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432786.566597:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 85 00000100:00100000:2.0:1787432786.566610:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+21:2375:x1874258791857280:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432786.566639:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432786.566648:0:8489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10967 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f4f expref: 21 pid: 5867 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.566710:0:8489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10967 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f4f expref: 21 pid: 5867 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.566741:0:8489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff935b8304a300) 00010000:00010000:2.0:1787432786.566748:0:8489:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f109ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.566759:0:8489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f109ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.566768:0:8489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f109ad lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.566795:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432786.566865:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+21:2375:x1874258791857280:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 258us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432786.566908:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 85 00010000:00010000:3.0:1787432786.567726:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f10967 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f4f expref: 20 pid: 5867 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432786.567752:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb4b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5867:1874258812814208:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787432786.567778:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f109ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.567788:0:5867:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f109ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.567794:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f109ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.567830:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f109ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.567850:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f109ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.567857:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f109ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.567864:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cee00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432786.567870:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f109ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.567888:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f109ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.567902:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff935b8304a300) 00010000:00010000:3.0:1787432786.567905:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787432786.567910:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f109ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.567915:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f109ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432786.567985:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+19:11646:x1874258791857152:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 Request processed in 10716us (10976us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787432786.567993:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 229 00000100:00100000:3.0:1787432786.585366:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432786.586823:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791857408 00000100:00100000:2.0:1787432786.586846:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791857408 00000100:00100000:2.0:1787432786.587027:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 71 00000100:00100000:2.0:1787432786.587042:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+8:2377:x1874258791857408:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787432786.587123:0:6726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a294a75b/0xbcb9e331c3f109b4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.587151:0:6726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f10991 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a025f6b expref: 8 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.587162:0:6726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787432786.587167:0:6726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787432786.587174:0:6726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a294a75b/0xbcb9e331c3f109b4 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.587225:0:6726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f10991 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x93816182a025f6b expref: 8 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.587242:0:6726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f10991 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025f6b expref: 8 pid: 6725 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432786.587259:0:6726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6726:1874258812814336:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432786.587384:0:6726:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87b6f000 going to sleep for 11 seconds 00000100:00100000:0.0:1787432786.600804:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432786.601521:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791857536 00000100:00100000:1.0:1787432786.601535:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791857536 00010000:00010000:1.0:1787432786.601615:0:5853:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f10991 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025f6b expref: 9 pid: 6725 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432786.601718:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 86 00000100:00100000:1.0:1787432786.601731:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+9:2376:x1874258791857536:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432786.601751:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432786.601782:0:5853:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f10991 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025f6b expref: 9 pid: 6725 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.601799:0:5853:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f10991 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025f6b expref: 9 pid: 6725 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.601850:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787432786.601856:0:5853:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787432786.601863:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a294a75b/0xbcb9e331c3f109b4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.602360:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a294a75b/0xbcb9e331c3f109b4 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.602399:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432786.602633:0:6726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af5490fb/0xbcb9e331c3f10991 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x93816182a025f6b expref: 9 pid: 6725 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432786.602694:0:6726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6726:1874258812814336:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787432786.602724:0:6726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a294a75b/0xbcb9e331c3f109b4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.602736:0:6726:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a294a75b/0xbcb9e331c3f109b4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.602744:0:6726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a294a75b/0xbcb9e331c3f109b4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.602782:0:6726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a294a75b/0xbcb9e331c3f109b4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.602791:0:6726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a294a75b/0xbcb9e331c3f109b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.602799:0:6726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a294a75b/0xbcb9e331c3f109b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.602807:0:6726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fa00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432786.602812:0:6726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a294a75b/0xbcb9e331c3f109b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.602822:0:6726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a294a75b/0xbcb9e331c3f109b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.602845:0:6726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a294a75b/0xbcb9e331c3f109b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.602853:0:6726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a294a75b/0xbcb9e331c3f109b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432786.603334:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee8b542c-0113-490f-a721-62606ee0807f+8:2376:x1874258791857536:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 1603us (2542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432786.603345:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 86 00000100:00100000:2.0:1787432786.609617:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+7:2377:x1874258791857408:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 Request processed in 22556us (24243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432786.609650:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 71 00000100:00100000:0.0:1787432786.623000:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432786.623233:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791857792 00000100:00100000:1.0:1787432786.623247:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791857792 00000100:00100000:1.0:1787432786.623328:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 230 00000100:00100000:1.0:1787432786.623340:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+19:11646:x1874258791857792:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787432786.623453:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f109bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.623478:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f109bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.623493:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f109bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.623862:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f109c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.624084:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10975 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f56 expref: 20 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.624093:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f109c2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.624296:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10975 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f56 expref: 20 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.624315:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10975 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f56 expref: 20 pid: 5868 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432786.624331:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a94380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5869:1874258812814464:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787432786.624436:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb9563600 going to sleep for 11 seconds 00000100:00100000:0.0:1787432786.629383:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432786.629534:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791857920 00000100:00100000:2.0:1787432786.629549:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791857920 00010000:00010000:2.0:1787432786.629608:0:8489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10975 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f56 expref: 21 pid: 5868 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432786.629730:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 87 00000100:00100000:2.0:1787432786.629743:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b909b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+21:2375:x1874258791857920:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432786.629762:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432786.629771:0:8489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10975 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f56 expref: 21 pid: 5868 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.629788:0:8489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10975 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f56 expref: 21 pid: 5868 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.629816:0:8489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff935b8304a300) 00010000:00010000:2.0:1787432786.629822:0:8489:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f109c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.629851:0:8489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f109c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.629859:0:8489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f109c2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432786.630331:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432786.630418:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b909b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+21:2375:x1874258791857920:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 674us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432786.630430:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 87 00010000:00010000:1.0:1787432786.630855:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f10975 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f56 expref: 20 pid: 5868 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432786.630889:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a94380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5869:1874258812814464:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787432786.630917:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f109c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.630929:0:5869:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f109c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.630935:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f109c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787432786.631593:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1787432786.631894:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1787432786.631951:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1787432786.635819:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9a94380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5869:1874258812814592:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787432786.636501:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432786.636559:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb9563c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432786.637208:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812814592 00000100:00100000:2.0:1787432786.637220:0:5873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812814592 00000100:00100000:2.0:1787432786.637301:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787432786.637313:0:5873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5869:x1874258812814592:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787432786.637443:0:5873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5869:x1874258812814592:12345-0@lo:1000:mdt00_002.0 Request processed in 131us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432786.637450:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787432786.637719:0:5869:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1787432786.637728:0:5869:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1787432786.637755:0:5869:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff935bbb4b3800, transno 4294967321 00000100:00100000:3.0:1787432786.637780:0:5869:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff935bbb4b3480 x1874258812813824/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787432802 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432786.637819:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9a94380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5869:1874258812814592:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787432786.639506:0:5869:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1787432786.641174:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb4b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5869:1874258812814720:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787432786.641287:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432786.641339:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba81a000 going to sleep for 11 seconds 00000100:00100000:2.0:1787432786.641586:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812814720 00000100:00100000:2.0:1787432786.641596:0:5873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812814720 00000100:00100000:2.0:1787432786.641703:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787432786.641715:0:5873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5869:x1874258812814720:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787432786.642038:0:5873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5869:x1874258812814720:12345-0@lo:1000:mdt00_002.0 Request processed in 323us (750us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787432786.642046:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787432786.642426:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb4b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5869:1874258812814720:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787432786.642484:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f109c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.642497:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f109c2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.642507:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f109c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.642514:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6e00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432786.642520:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f109c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.642528:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f109c2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.642581:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff935b8304a300) 00010000:00010000:0.0:1787432786.642585:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787432786.642591:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f109c2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.642598:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6e00/0xbcb9e331c3f109c2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.642706:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10905 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.642714:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10905 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.642719:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10905 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.642724:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432786.642727:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10905 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.642733:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10905 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.642741:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:0.0:1787432786.642744:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787432786.642752:0:5869:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f1090c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f3a expref: 23 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.642765:0:5869:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f1090c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f3a expref: 23 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.642782:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f1090c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f3a expref: 23 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.642819:0:5869:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f1090c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f3a expref: 23 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432786.642832:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb4b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5869:1874258812814848:192.168.202.15@tcp:105: 00000100:00100000:0.0:1787432786.646202:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bba81a000 going to sleep for 11 seconds 00000100:00100000:1.0:1787432786.656291:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb4b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5869:1874258812814848:192.168.202.15@tcp:105: 00010000:00010000:1.0:1787432786.656332:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10905 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.656346:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f10905 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6929 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.656390:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f109c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.656408:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f109c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.656422:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f109c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.656434:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f109c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.656440:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f109c9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.656447:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f109c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.656453:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e7200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432786.656457:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f109c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.656483:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f109c9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.656498:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:1.0:1787432786.656501:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432786.656505:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f109c9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.656511:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7200/0xbcb9e331c3f109c9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.656521:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f109bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.656527:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f109bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.656532:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f109bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.656537:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432786.656540:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f109bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.656545:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f109bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.656552:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:1.0:1787432786.656554:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787432786.656557:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f109bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432786.656573:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6200/0xbcb9e331c3f109bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432786.657313:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+23:11646:x1874258791857792:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 33655us (34019us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1787432786.657330:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 230 00000020:00080000:1.0:1787432786.657338:0:5869:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787432786.658013:0:11725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787432786.658022:0:11725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787432786.658525:0:11725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787432786.658544:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787432786.659888:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432786.660345:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791858048 00000100:00100000:0.0:1787432786.660361:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791858048 00000100:00100000:0.0:1787432786.660438:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:0.0:1787432786.660451:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+23:11645:x1874258791858048:12345-192.168.202.15@tcp:49:lfs.0 00000100:00100000:0.0:1787432786.660648:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+23:11645:x1874258791858048:12345-192.168.202.15@tcp:49:lfs.0 Request processed in 198us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432786.660699:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:0.0:1787432786.678578:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432786.678636:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791858304 00000100:00100000:0.0:1787432786.678649:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791858304 00000100:00100000:0.0:1787432786.678735:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:0.0:1787432786.678747:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8355e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+23:11646:x1874258791858304:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787432786.681854:0:5870:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787432786.683223:0:5870:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1787432786.683323:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f109d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.683363:0:5870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f109d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.683378:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f109d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.683388:0:5870:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f109d0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.683395:0:5870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f109d0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.683401:0:5870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f109d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432786.683427:0:5870:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787432786.683585:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8355e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+25:11646:x1874258791858304:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 4832us (5015us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787432786.683598:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 62 00000020:00080000:0.0:1787432786.683604:0:5870:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787432786.683943:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432786.683953:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f109d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.683962:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1cfa00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:3.0:1787432786.683967:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f109d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.683987:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f109d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.684009:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff935b9838f600) 00010000:00010000:3.0:1787432786.684013:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787432786.684019:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f109d0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.684026:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfa00/0xbcb9e331c3f109d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.684046:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432786.684047:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432786.684049:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432786.688924:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432786.688969:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791858560 00000100:00100000:2.0:1787432786.688982:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791858560 00000100:00100000:2.0:1787432786.689050:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 231 00000100:00100000:2.0:1787432786.689062:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+25:11645:x1874258791858560:12345-192.168.202.15@tcp:58:lfs.0 00000040:00080000:2.0:1787432786.689427:0:5868:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787432786.689527:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+25:11645:x1874258791858560:12345-192.168.202.15@tcp:58:lfs.0 Request processed in 466us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432786.689536:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 231 00000100:00100000:0.0:1787432786.724363:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432786.725261:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791858688 00000100:00100000:3.0:1787432786.725279:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791858688 00000100:00100000:3.0:1787432786.725371:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 232 00000100:00100000:3.0:1787432786.725386:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+25:11648:x1874258791858688:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432786.725441:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432786.725473:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f109d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f72 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.725569:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109de lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.725589:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.725602:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.725621:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f109e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.725640:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f109e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.725647:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f109e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.726345:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f109ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.726364:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f33 expref: 26 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.726373:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f109ec lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.726421:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f33 expref: 26 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.726446:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f33 expref: 26 pid: 5868 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432786.726464:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5867:1874258812814976:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787432786.726601:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87855f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432786.744067:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432786.744122:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791858944 00000100:00100000:1.0:1787432786.744134:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791858944 00000100:00100000:1.0:1787432786.744214:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:1.0:1787432786.744227:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+27:5617:x1874258791858944:12345-192.168.202.15@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787432786.744552:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+28:5617:x1874258791858944:12345-192.168.202.15@tcp:35:ldlm_bl.0 Request processed in 326us (501us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1787432786.744562:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:3.0:1787432786.747760:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5867:1874258812814976:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787432786.747802:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f109ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432786.748011:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432786.751474:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791859072 00000100:00100000:3.0:1787432786.751497:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791859072 00010000:00010000:3.0:1787432786.751572:0:5851:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f33 expref: 28 pid: 5868 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432786.751650:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 88 00000100:00100000:3.0:1787432786.751703:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+28:2375:x1874258791859072:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432786.751723:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432786.751732:0:5851:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f33 expref: 28 pid: 5868 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.751750:0:5851:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f33 expref: 28 pid: 5868 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.751779:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155200/0xbcb9e331c3f108f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025f33 expref: 28 pid: 5868 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.751825:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:3.0:1787432786.751831:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f109ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.751842:0:5851:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f109ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.751851:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f109ec lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.751885:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432786.751993:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee8b542c-0113-490f-a721-62606ee0807f+27:2375:x1874258791859072:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 293us (3990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432786.752002:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 88 00010000:00010000:3.0:1787432786.752180:0:5867:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f109ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.752189:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f109ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432786.752342:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787432786.752348:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432786.752376:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f109ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.752392:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f109ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.752405:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.752426:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.752433:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.752440:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432786.752445:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.752455:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.752467:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:3.0:1787432786.752470:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432786.752474:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.752480:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f109de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.752495:0:5867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f109e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.752501:0:5867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f109e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.752506:0:5867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f109e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.752510:0:5867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154a00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432786.752519:0:5867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f109e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.752526:0:5867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f109e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.752534:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff935b8304a900) 00010000:00010000:3.0:1787432786.752536:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432786.752539:0:5867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f109e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.752545:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154a00/0xbcb9e331c3f109e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.752591:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f109d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f72 expref: 27 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.752607:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f109ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f72 expref: 26 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432786.752615:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:3.0:1787432786.752617:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432786.752619:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2155600, rc 0) 00000100:00100000:3.0:1787432786.752718:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+26:11648:x1874258791858688:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 27335us (28371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432786.752727:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 232 00000001:00080000:0.0:1787432786.764862:0:6749:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1787432786.764902:0:6749:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1787432786.872306:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432786.872372:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432786.872441:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432786.872556:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791859456 00000100:00100000:1.0:1787432786.872571:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791859456 00000100:00100000:1.0:1787432786.872719:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 167 00000100:00100000:1.0:1787432786.872732:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2376:x1874258791859456:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432786.872835:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2376:x1874258791859456:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 106us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432786.872844:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 167 00000100:00080000:0.0:1787432786.872979:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432786.873132:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791859200 00000100:00100000:2.0:1787432786.873138:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791859200 00000100:00100000:2.0:1787432786.873181:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 300 00000100:00100000:2.0:1787432786.873190:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2376:x1874258791859200:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787432786.873225:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2376:x1874258791859200:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 39us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432786.873232:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 300 00000100:00100000:3.0:1787432786.873455:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791859328 00000100:00100000:3.0:1787432786.873461:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791859328 00000100:00100000:3.0:1787432786.873548:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 95 00000100:00100000:3.0:1787432786.873567:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2376:x1874258791859328:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432786.873644:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2376:x1874258791859328:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 89us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432786.873651:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 95 00010000:00010000:1.0:1787432787.071804:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787432787.702542:0:11725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787432787.702561:0:11725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787432787.702630:0:11725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787432787.702639:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787432787.702845:0:11725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabbd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11725:1874258812815104:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787432787.703741:0:11725:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87855600 going to sleep for 11 seconds 00000100:00100000:3.0:1787432787.737581:0:11725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabbd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11725:1874258812815104:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787432787.741065:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432787.741255:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791859584 00000100:00100000:0.0:1787432787.741278:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791859584 00000100:00100000:0.0:1787432787.741359:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 233 00000100:00100000:0.0:1787432787.741372:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+26:11659:x1874258791859584:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787432787.741425:0:6929:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787432787.741570:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+26:11659:x1874258791859584:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 201us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432787.741580:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 233 00000100:00100000:3.0:1787432787.766428:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432787.766482:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791859840 00000100:00100000:3.0:1787432787.766497:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791859840 00000100:00100000:3.0:1787432787.766587:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 234 00000100:00100000:3.0:1787432787.766601:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+26:11659:x1874258791859840:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432787.766645:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432787.766726:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f109f3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f79 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432787.766876:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f109fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432787.766899:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f109fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432787.766922:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f109fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432787.766960:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787432787.767196:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f109f3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f79 expref: 29 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432787.767225:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f109fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f79 expref: 28 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432787.767237:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:3.0:1787432787.767240:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432787.767245:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154800, rc 0) 00000100:00100000:3.0:1787432787.767333:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+28:11659:x1874258791859840:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 735us (921us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787432787.767342:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 234 00000100:00100000:3.0:1787432787.781638:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432787.781731:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432787.781781:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791860224 00000100:00100000:3.0:1787432787.781795:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791860224 00000100:00100000:3.0:1787432787.781885:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:3.0:1787432787.781901:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86830380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+28:2376:x1874258791860224:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432787.781929:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432787.781976:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154800/0xbcb9e331c3f109fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f79 expref: 28 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432787.782017:0:8489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:3.0:1787432787.782025:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432787.782103:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86830380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ee8b542c-0113-490f-a721-62606ee0807f+27:2376:x1874258791860224:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 206us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432787.782123:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:2.0:1787432787.782727:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791860096 00000100:00100000:2.0:1787432787.782737:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791860096 00000100:00100000:2.0:1787432787.782793:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 235 00000100:00100000:2.0:1787432787.782804:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+27:11659:x1874258791860096:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787432787.782913:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10a08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432787.782937:0:5868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10a08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432787.782951:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10a08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432787.783279:0:5868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10a08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432787.783289:0:5868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10a08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432787.783297:0:5868:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10a08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432787.783304:0:5868:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fa00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432787.783310:0:5868:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10a08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432787.783319:0:5868:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10a08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432787.783334:0:5868:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:2.0:1787432787.783337:0:5868:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787432787.783342:0:5868:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10a08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432787.783348:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fa00/0xbcb9e331c3f10a08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432787.783533:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8b542c-0113-490f-a721-62606ee0807f+28:11659:x1874258791860096:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 729us (1923us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787432787.783557:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 235 00000040:00080000:2.0:1787432787.787199:0:11725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787432787.787219:0:11725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787432787.787787:0:11725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787432787.787814:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787432787.801118:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432787.801298:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791860480 00000100:00100000:2.0:1787432787.801315:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791860480 00000100:00100000:2.0:1787432787.801401:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 64 00000100:00100000:2.0:1787432787.801425:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b86832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+28:11659:x1874258791860480:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787432787.801820:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b86832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+29:11659:x1874258791860480:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 408us (720us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787432787.801831:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 64 00000040:00080000:1.0:1787432788.056384:0:12556:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787432788.056398:0:12556:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787432788.056454:0:12556:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787432788.056468:0:12556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787432788.087087:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432788.383884:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432788.384021:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791860736 00000100:00100000:0.0:1787432788.384035:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791860736 00000100:00100000:0.0:1787432788.384130:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 236 00000100:00100000:0.0:1787432788.384143:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+29:11672:x1874258791860736:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787432788.384175:0:8110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432788.384200:0:8110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10a0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f80 expref: -99 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432788.384337:0:8110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f10a16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432788.384355:0:8110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f10a16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432788.384372:0:8110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f10a16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432788.384385:0:8110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787432788.384553:0:8110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cea00/0xbcb9e331c3f10a0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f80 expref: 32 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432788.384575:0:8110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f10a16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f80 expref: 31 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432788.384604:0:8110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:0.0:1787432788.384607:0:8110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787432788.384624:0:8110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cee00, rc 0) 00000100:00100000:0.0:1787432788.384743:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+31:11672:x1874258791860736:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 602us (875us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787432788.384750:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 236 00000100:00080000:2.0:1787432788.385194:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432788.387953:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432788.392179:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791860864 00000100:00100000:3.0:1787432788.392202:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791860864 00000100:00100000:3.0:1787432788.392300:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 237 00000100:00100000:3.0:1787432788.392313:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+31:11672:x1874258791860864:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:3.0:1787432788.392414:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10a24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432788.392437:0:5869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10a24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432788.392451:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10a24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432788.392501:0:5869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10a24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432788.392509:0:5869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10a24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432788.392516:0:5869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10a24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432788.392522:0:5869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432788.392528:0:5869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10a24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432788.392536:0:5869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10a24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432788.392565:0:5869:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:3.0:1787432788.392569:0:5869:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432788.392576:0:5869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10a24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432788.392583:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154000/0xbcb9e331c3f10a24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432788.392739:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8b542c-0113-490f-a721-62606ee0807f+31:11672:x1874258791860864:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 427us (4796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432788.392747:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 237 00000100:00100000:0.0:1787432788.606947:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432788.607054:0:12109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791860992 00000100:00100000:3.0:1787432788.607066:0:12109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791860992 00000100:00100000:3.0:1787432788.607143:0:12109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 72 00000100:00100000:3.0:1787432788.607169:0:12109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+7:2376:x1874258791860992:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:3.0:1787432788.607192:0:12109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432788.607215:0:12109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd09371d/0xbcb9e331c3f10a2b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f87 expref: -99 pid: 12109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787432788.607242:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1787432788.607246:0:12109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8a0f51, atime: 0x6a8a0f51, ctime: 0x6a8a0f51, blocks: 0xb 00010000:00010000:3.0:1787432788.607271:0:12109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1787432788.607276:0:12109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432788.607287:0:12109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd09371d/0xbcb9e331c3f10a2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f87 expref: 8 pid: 12109 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432788.607318:0:12109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cd09371d/0xbcb9e331c3f10a2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f87 expref: 8 pid: 12109 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432788.607354:0:12109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154000, rc 0) 00000100:00100000:3.0:1787432788.607423:0:12109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+8:2376:x1874258791860992:12345-192.168.202.15@tcp:101:cat.0 Request processed in 259us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432788.607430:0:12109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 72 00000100:00100000:2.0:1787432788.616094:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432788.616237:0:6730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791861120 00000100:00100000:1.0:1787432788.616253:0:6730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791861120 00002000:00100000:1.0:1787432788.616340:0:6730:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff935bb95afb80 x1874258791861120/t0(0) o3->ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp:499/0 lens 488/0 e 0 to 0 dl 1787432799 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787432788.616354:0:6730:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935bb95afb80 with x1874258791861120 ext(0->4095) 00002000:00010000:1.0:1787432788.616362:0:6730:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff935bb95afb80 00000100:00100000:1.0:1787432788.616528:0:6730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:1.0:1787432788.616552:0:6730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ee8b542c-0113-490f-a721-62606ee0807f+8:2376:x1874258791861120:12345-192.168.202.15@tcp:3:cat.0 00000100:00100000:1.0:1787432788.617088:0:6730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ee8b542c-0113-490f-a721-62606ee0807f+8:2376:x1874258791861120:12345-192.168.202.15@tcp:3:cat.0 Request processed in 545us (1006us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787432788.617098:0:6730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00002000:00100000:1.0:1787432788.617106:0:6730:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff935bb95afb80 x1874258791861120/t0(0) o3->ee8b542c-0113-490f-a721-62606ee0807f@192.168.202.15@tcp:499/0 lens 488/4536 e 0 to 0 dl 1787432799 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787432788.617116:0:6730:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935bb95afb80 with x1874258791861120 ext(0->4095) 00002000:00010000:1.0:1787432788.617123:0:6730:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff935bb95afb80 00000040:00080000:2.0:1787432788.791733:0:11725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787432788.791745:0:11725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787432788.791791:0:11725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787432788.791799:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787432789.111323:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432790.137540:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432790.279346:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812815616:0@lo:400:kworker.0 00000100:00100000:1.0:1787432790.279421:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432790.279482:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787432790.279488:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba866680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812815232:0@lo:400:kworker.0 00000100:00100000:2.0:1787432790.279712:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812815488:0@lo:400:kworker.0 00000100:00100000:2.0:1787432790.279750:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432790.279780:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787432790.279785:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba864000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812815360:0@lo:400:kworker.0 00000100:00100000:2.0:1787432790.279807:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432790.279825:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812815872:0@lo:400:kworker.0 00000100:00100000:2.0:1787432790.279847:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432790.279877:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812815616 00000100:00100000:2.0:1787432790.279885:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812815616 00000100:00100000:2.0:1787432790.279938:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812815872 00000100:00100000:2.0:1787432790.279955:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812815872 00000100:00100000:2.0:1787432790.279988:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787432790.279997:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812815616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432790.280067:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812815616:12345-0@lo:400:kworker.0 Request processed in 71us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432790.280076:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787432790.280093:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787432790.280100:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3333:x1874258812815872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432790.280132:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3333:x1874258812815872:12345-0@lo:400:kworker.0 Request processed in 32us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432790.280139:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787432790.280158:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812815488 00000100:00100000:2.0:1787432790.280162:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812815488 00000100:00100000:2.0:1787432790.280188:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812815360 00000100:00100000:2.0:1787432790.280191:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812815360 00000100:00100000:2.0:1787432790.280210:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787432790.280217:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812815488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432790.280248:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812815488:12345-0@lo:400:kworker.0 Request processed in 32us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432790.280254:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787432790.280266:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787432790.280272:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba45d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812815360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432790.280298:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba45d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812815360:12345-0@lo:400:kworker.0 Request processed in 27us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432790.280304:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:2.0:1787432790.280324:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787432790.280328:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787432790.280336:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787432790.280371:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba864000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812815360:0@lo:400:kworker.0 00000100:00100000:2.0:1787432790.280381:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812815872:0@lo:400:kworker.0 00000100:00100000:2.0:1787432790.280389:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812815488:0@lo:400:kworker.0 00000100:00100000:1.0:1787432790.280784:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432790.280812:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812815744:0@lo:400:kworker.0 00000100:00100000:1.0:1787432790.280838:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432790.280858:0:3330:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787432790.280869:0:3330:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:1.0:1787432790.280886:0:3330:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff935bb9fd3480, transno 4294967307 00000004:00080000:1.0:1787432790.280893:0:3330:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1787432790.280905:0:3330:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff935bb95ad880, transno 4294967310 00000100:00100000:1.0:1787432790.280910:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812815616:0@lo:400:kworker.0 00000100:00100000:2.0:1787432790.280992:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812815232 00000100:00100000:2.0:1787432790.281007:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812815232 00000100:00100000:2.0:1787432790.281039:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787432790.281046:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812815232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432790.281085:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812815232:12345-0@lo:400:kworker.0 Request processed in 40us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432790.281091:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787432790.281113:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812815744 00000100:00100000:2.0:1787432790.281116:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812815744 00000100:00100000:2.0:1787432790.281140:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787432790.281145:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812815744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432790.281169:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812815744:12345-0@lo:400:kworker.0 Request processed in 24us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432790.281174:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:2.0:1787432790.281407:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432790.281428:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba866680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812815232:0@lo:400:kworker.0 00000100:00100000:2.0:1787432790.281441:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812815744:0@lo:400:kworker.0 00000100:00100000:3.0:1787432790.773988:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812816000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432790.774073:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432790.774203:0:9985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812816000 00000100:00100000:2.0:1787432790.774211:0:9985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812816000 00000100:00100000:2.0:1787432790.774266:0:9985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787432790.774276:0:9985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba734000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3333:x1874258812816000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432790.774326:0:9985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432790.774374:0:9985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba734000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3333:x1874258812816000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432790.774382:0:9985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787432790.774425:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812816000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432790.775116:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787432790.775129:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbabb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812816128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432790.775171:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432790.775360:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812816128 00000100:00100000:1.0:1787432790.775365:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812816128 00000100:00100000:1.0:1787432790.775405:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787432790.775414:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812816128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432790.775437:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787432790.775786:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbabb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812816128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432790.775970:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812816128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432790.775978:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:2.0:1787432791.157859:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787432791.867016:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:1.0:1787432791.867039:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1787432791.940237:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1787432791.940439:0:5889:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1787432791.940468:0:5889:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff935b878559c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787432791.940473:0:5889:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff935b87d5cb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff935b87855900 00000020:00080000:2.0:1787432791.940476:0:5889:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff935b87d5c000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff935b87c40c00 00000020:00080000:3.0:1787432791.940531:0:5900:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1787432791.940789:0:5900:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1787432791.987242:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432791.987295:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432791.987332:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432791.987366:0:12109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791861632 00000100:00100000:3.0:1787432791.987374:0:12109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791861632 00000100:00100000:3.0:1787432791.987437:0:12109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 98 00000100:00100000:3.0:1787432791.987449:0:12109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba735880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+7:2377:x1874258791861632:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432791.987538:0:12109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba735880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+7:2377:x1874258791861632:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 92us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432791.987546:0:12109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 98 00000100:00080000:3.0:1787432791.987589:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432791.987801:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791861376 00000100:00100000:1.0:1787432791.987805:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791861376 00000100:00100000:1.0:1787432791.987855:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 171 00000100:00100000:1.0:1787432791.987863:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+18:2377:x1874258791861376:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432791.987904:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+18:2377:x1874258791861376:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 42us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432791.987910:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 171 00000100:00100000:2.0:1787432791.988085:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791861248 00000100:00100000:2.0:1787432791.988090:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791861248 00000100:00100000:2.0:1787432791.988122:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 302 00000100:00100000:2.0:1787432791.988129:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2378:x1874258791861248:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787432791.988159:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2378:x1874258791861248:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 31us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432791.988165:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 302 00000100:00080000:3.0:1787432791.988339:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432791.992573:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432791.992731:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432791.994279:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791861760 00000100:00100000:3.0:1787432791.994294:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791861760 00000100:00100000:3.0:1787432791.994376:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 172 00000100:00100000:3.0:1787432791.994388:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2378:x1874258791861760:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432791.994519:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:2378:x1874258791861760:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 133us (1787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432791.994528:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 172 00000100:00080000:1.0:1787432791.995289:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432791.998401:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791861504 00000100:00100000:2.0:1787432791.998421:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791861504 00000100:00100000:2.0:1787432791.999958:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 99 00000100:00100000:2.0:1787432791.999971:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2378:x1874258791861504:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787432792.000042:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2378:x1874258791861504:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 75us (7492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432792.000050:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 99 00000100:00080000:1.0:1787432792.002861:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787432792.182973:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432793.208833:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432794.230759:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432794.728248:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432794.728372:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791861888 00000100:00100000:2.0:1787432794.728384:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791861888 00000100:00100000:2.0:1787432794.728531:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 238 00000100:00100000:2.0:1787432794.728543:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+18:11334:x1874258791861888:12345-192.168.202.15@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787432794.728710:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8b542c-0113-490f-a721-62606ee0807f+18:11334:x1874258791861888:12345-192.168.202.15@tcp:60:lhsmtool_posix.0 Request processed in 168us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432794.728718:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 238 00000100:00080000:1.0:1787432794.731755:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432794.740379:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432794.740490:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791862144 00000100:00100000:0.0:1787432794.740501:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791862144 00000100:00100000:0.0:1787432794.740624:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 65 00000100:00100000:0.0:1787432794.740635:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+18:11334:x1874258791862144:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787432794.741240:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+19:11334:x1874258791862144:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 605us (869us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787432794.741248:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 65 00000100:00100000:0.0:1787432795.039410:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432795.039513:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791862272 00000100:00100000:2.0:1787432795.039523:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791862272 00000100:00100000:2.0:1787432795.039714:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 239 00000100:00100000:2.0:1787432795.039725:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+5:12124:x1874258791862272:12345-192.168.202.15@tcp:101:lsof.0 00010000:00010000:2.0:1787432795.039743:0:5867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432795.039770:0:5867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10a32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a025f8e expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.039831:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10a39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.039845:0:5867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10a39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.039858:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10a39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432795.040252:0:5867:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787432795.040257:0:5867:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787432795.040343:0:5867:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10a39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.040382:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10a32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f8e expref: 7 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.040399:0:5867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10a39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f8e expref: 6 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432795.040406:0:5867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a200) 00010000:00010000:2.0:1787432795.040409:0:5867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787432795.040412:0:5867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f400, rc 0) 00000100:00100000:2.0:1787432795.040484:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:12124:x1874258791862272:12345-192.168.202.15@tcp:101:lsof.0 Request processed in 759us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432795.040492:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 239 00000100:00080000:1.0:1787432795.043627:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787432795.254012:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432795.386087:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba866680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812816512:0@lo:400:kworker.0 00000100:00100000:2.0:1787432795.386165:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432795.386233:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787432795.386240:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812816384:0@lo:400:kworker.0 00000100:00100000:2.0:1787432795.386265:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432795.386286:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935b98b1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812816896:0@lo:400:kworker.0 00000100:00100000:3.0:1787432795.386312:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812816512 00000100:00100000:3.0:1787432795.386322:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812816512 00000100:00100000:2.0:1787432795.386332:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432795.386368:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812816896 00000100:00100000:2.0:1787432795.386373:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812816896 00000100:00100000:3.0:1787432795.386389:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812816384 00000100:00100000:3.0:1787432795.386394:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812816384 00000100:00100000:2.0:1787432795.386417:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787432795.386424:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787432795.386429:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812816896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432795.386437:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b98b1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812816512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432795.386493:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812816896:12345-0@lo:400:kworker.0 Request processed in 66us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432795.386513:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b98b1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812816512:12345-0@lo:400:kworker.0 Request processed in 66us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432795.386521:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787432795.386525:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787432795.386554:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787432795.386562:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812816384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432795.386584:0:3333:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1787432795.386591:0:3333:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff935bbb4b3480, transno 4294967322 00000100:00100000:3.0:1787432795.386596:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812816384:12345-0@lo:400:kworker.0 Request processed in 35us (329us total) trans 0 rc 0/0 00000004:00080000:2.0:1787432795.386603:0:3333:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1787432795.386604:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787432795.386633:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935b98b1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812816896:0@lo:400:kworker.0 00000100:00080000:3.0:1787432795.386636:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432795.386643:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432795.386651:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba866680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812816512:0@lo:400:kworker.0 00000100:00100000:2.0:1787432795.386702:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812816384:0@lo:400:kworker.0 00000100:00100000:1.0:1787432795.387178:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba864000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812816640:0@lo:400:kworker.0 00000100:00100000:1.0:1787432795.387221:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432795.387258:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787432795.387266:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812816256:0@lo:400:kworker.0 00000100:00100000:1.0:1787432795.387295:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432795.387345:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba8fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812816768:0@lo:400:kworker.0 00000100:00100000:1.0:1787432795.387370:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432795.387799:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812816256 00000100:00100000:2.0:1787432795.387806:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812816256 00000100:00100000:2.0:1787432795.387858:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787432795.387867:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812816256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432795.388640:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812816640 00000100:00100000:3.0:1787432795.388647:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812816640 00000100:00100000:2.0:1787432795.388711:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812816256:12345-0@lo:400:kworker.0 Request processed in 843us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432795.388723:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787432795.388739:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787432795.388750:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbabb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812816640:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787432795.388792:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432795.388801:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812816256:0@lo:400:kworker.0 00000100:00100000:1.0:1787432795.388820:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812816768 00000100:00100000:1.0:1787432795.388825:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812816768 00000100:00080000:0.0:1787432795.388852:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432795.388869:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787432795.388878:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812816768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432795.388928:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812816768:12345-0@lo:400:kworker.0 Request processed in 51us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432795.388938:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787432795.388955:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba8fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812816768:0@lo:400:kworker.0 00000100:00100000:3.0:1787432795.389365:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbabb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812816640:12345-0@lo:400:kworker.0 Request processed in 615us (2142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432795.389386:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787432795.389477:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba864000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812816640:0@lo:400:kworker.0 00000100:00100000:3.0:1787432795.894134:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812817024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432795.894232:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432795.894649:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812817152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432795.894710:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432795.894871:0:9985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812817024 00000100:00100000:3.0:1787432795.894879:0:9985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812817024 00000100:00100000:3.0:1787432795.894934:0:9985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812817152 00000100:00100000:3.0:1787432795.894938:0:9985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812817152 00000100:00100000:2.0:1787432795.894945:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787432795.894959:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812817024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432795.894998:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432795.895064:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812817024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432795.895140:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812817024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432795.897986:0:9985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787432795.898012:0:9985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a85a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812817152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787432795.898173:0:9985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787432795.898270:0:9985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a85a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812817152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 271us (3559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432795.898278:0:9985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787432795.898501:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812817152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432795.899954:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:1.0:1787432796.278038:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787432796.951682:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1787432796.951699:0:5889:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1787432796.951714:0:5900:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1787432796.951723:0:5900:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1787432797.106541:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432797.106592:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432797.106632:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432797.106696:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432797.106744:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432797.106787:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791862528 00000100:00100000:1.0:1787432797.106790:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791862400 00000100:00100000:3.0:1787432797.106796:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791862528 00000100:00100000:1.0:1787432797.106797:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791862400 00000100:00100000:3.0:1787432797.106853:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791862912 00000100:00100000:1.0:1787432797.106853:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 304 00000100:00100000:3.0:1787432797.106859:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791862912 00000100:00100000:1.0:1787432797.106867:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2378:x1874258791862400:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432797.106883:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 176 00000100:00100000:3.0:1787432797.106892:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+18:2378:x1874258791862528:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432797.106941:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2378:x1874258791862400:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 76us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432797.106943:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+18:2378:x1874258791862528:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 50us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432797.106954:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 176 00000100:00100000:1.0:1787432797.106971:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 304 00000100:00100000:3.0:1787432797.106986:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 177 00000100:00100000:3.0:1787432797.106996:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:2378:x1874258791862912:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432797.107027:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:2378:x1874258791862912:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 33us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432797.107034:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 177 00000100:00080000:3.0:1787432797.107055:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432797.107077:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791862784 00000100:00100000:3.0:1787432797.107081:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791862784 00000100:00100000:3.0:1787432797.107111:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791862656 00000100:00100000:3.0:1787432797.107115:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791862656 00000100:00100000:3.0:1787432797.107142:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 102 00000100:00100000:3.0:1787432797.107150:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+7:2378:x1874258791862784:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432797.107180:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 103 00000100:00100000:3.0:1787432797.107188:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+7:2378:x1874258791862784:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 39us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432797.107194:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb6e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2378:x1874258791862656:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432797.107201:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 102 00000100:00100000:1.0:1787432797.107230:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb6e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee8b542c-0113-490f-a721-62606ee0807f+5:2378:x1874258791862656:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 41us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432797.107248:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 103 00000100:00080000:3.0:1787432797.107266:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787432797.107271:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787432797.302222:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787432798.006917:0:11725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787432798.006927:0:11725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787432798.007563:0:11725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1787432798.007571:0:11725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787432798.326592:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787432798.472761:0:12759:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 17:06:37 (1787432797) 00010000:00010000:3.0:1787432799.350857:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432800.388974:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432800.505006:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812817280:0@lo:400:kworker.0 00000100:00100000:1.0:1787432800.505096:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432800.505145:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812817792:0@lo:400:kworker.0 00000100:00100000:1.0:1787432800.505171:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432800.505199:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787432800.505205:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812817664:0@lo:400:kworker.0 00000100:00100000:1.0:1787432800.505230:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432800.505265:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812817536:0@lo:400:kworker.0 00000100:00100000:1.0:1787432800.505286:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432800.505302:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787432800.505308:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812817408:0@lo:400:kworker.0 00000100:00100000:1.0:1787432800.505325:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432800.505339:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812817920:0@lo:400:kworker.0 00000100:00100000:1.0:1787432800.505357:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432800.505384:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812817792 00000100:00100000:1.0:1787432800.505392:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812817792 00000100:00100000:1.0:1787432800.505461:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812817536 00000100:00100000:1.0:1787432800.505471:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812817536 00000100:00100000:2.0:1787432800.505588:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812817280 00000100:00100000:2.0:1787432800.505593:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812817280 00000100:00100000:2.0:1787432800.505626:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787432800.505635:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3331:x1874258812817280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432800.505713:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3331:x1874258812817280:12345-0@lo:400:kworker.0 Request processed in 79us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432800.505721:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787432800.505772:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812817280:0@lo:400:kworker.0 00000100:00100000:1.0:1787432800.510877:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812817408 00000100:00100000:1.0:1787432800.510894:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812817408 00000100:00100000:1.0:1787432800.510928:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787432800.510940:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812817792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432800.511049:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812817792:12345-0@lo:400:kworker.0 Request processed in 112us (5876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432800.511058:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787432800.511076:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787432800.511083:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812817536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432800.511120:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812817536:12345-0@lo:400:kworker.0 Request processed in 37us (5832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432800.511126:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787432800.511138:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787432800.511144:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812817408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432800.511173:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812817408:12345-0@lo:400:kworker.0 Request processed in 29us (5846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432800.511179:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787432800.511228:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812817792:0@lo:400:kworker.0 00000100:00100000:1.0:1787432800.511263:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812817408:0@lo:400:kworker.0 00000100:00100000:1.0:1787432800.511274:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812817536:0@lo:400:kworker.0 00000100:00100000:3.0:1787432800.513787:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812817664 00000100:00100000:3.0:1787432800.513801:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812817664 00000100:00100000:3.0:1787432800.513852:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812817920 00000100:00100000:3.0:1787432800.513856:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812817920 00000100:00100000:3.0:1787432800.513926:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787432800.513936:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812817664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432800.514037:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812817664:12345-0@lo:400:kworker.0 Request processed in 101us (8803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432800.514056:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787432800.514079:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787432800.514087:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812817920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432800.514120:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812817920:12345-0@lo:400:kworker.0 Request processed in 34us (8761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432800.514125:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1787432800.515031:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432800.515037:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787432800.515040:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432800.515084:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812817664:0@lo:400:kworker.0 00000100:00100000:3.0:1787432800.515122:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812817920:0@lo:400:kworker.0 00000100:00100000:3.0:1787432801.014542:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812818048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432801.014624:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432801.014784:0:6727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812818048 00000100:00100000:2.0:1787432801.014794:0:6727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812818048 00000100:00100000:2.0:1787432801.014856:0:6727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787432801.014868:0:6727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9557480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812818048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432801.014914:0:6727:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432801.014978:0:6727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9557480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812818048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432801.014985:0:6727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787432801.015036:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbb5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812818048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432801.022762:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787432801.022789:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812818176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432801.022864:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432801.022928:0:6728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812818176 00000100:00100000:1.0:1787432801.022950:0:6728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812818176 00000100:00100000:1.0:1787432801.023000:0:6728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787432801.023009:0:6728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812818176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432801.023046:0:6728:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432801.023093:0:6728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812818176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432801.023100:0:6728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787432801.023151:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812818176:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787432801.397971:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432802.229807:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432802.229866:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432802.229899:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432802.229958:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432802.229994:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432802.230023:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791863552 00000100:00100000:3.0:1787432802.230033:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791863552 00000100:00100000:3.0:1787432802.230093:0:8110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791863168 00000100:00100000:3.0:1787432802.230097:0:8110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791863168 00000100:00100000:3.0:1787432802.230122:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 181 00000100:00100000:3.0:1787432802.230131:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:2376:x1874258791863552:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432802.230223:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:2376:x1874258791863552:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 92us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432802.230237:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 181 00000100:00100000:3.0:1787432802.230269:0:8110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 182 00000100:00100000:3.0:1787432802.230275:0:8110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+18:2376:x1874258791863168:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432802.230304:0:8110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8b542c-0113-490f-a721-62606ee0807f+18:2376:x1874258791863168:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 29us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432802.230310:0:8110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 182 00000100:00100000:3.0:1787432802.230335:0:12109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791863296 00000100:00100000:3.0:1787432802.230338:0:12109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791863296 00000100:00100000:3.0:1787432802.230365:0:12109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791863424 00000100:00100000:3.0:1787432802.230367:0:12109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791863424 00000100:00100000:3.0:1787432802.230387:0:12109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 106 00000100:00100000:3.0:1787432802.230393:0:12109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+5:2376:x1874258791863296:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432802.230427:0:12109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+5:2376:x1874258791863296:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 34us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432802.230434:0:12109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 106 00000100:00100000:3.0:1787432802.230448:0:12109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 107 00000100:00100000:3.0:1787432802.230454:0:12109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+7:2376:x1874258791863424:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432802.230703:0:12109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8b542c-0113-490f-a721-62606ee0807f+7:2376:x1874258791863424:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 247us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432802.230710:0:12109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 107 00000100:00080000:3.0:1787432802.230731:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787432802.230736:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787432802.230738:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432802.231810:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791863040 00000100:00100000:1.0:1787432802.231821:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791863040 00000100:00100000:1.0:1787432802.231884:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 306 00000100:00100000:1.0:1787432802.231894:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2376:x1874258791863040:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432802.231952:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2376:x1874258791863040:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 59us (2155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432802.231959:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 306 00010000:00010000:3.0:1787432802.422992:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432803.445924:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432803.476920:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432803.477041:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791863808 00000100:00100000:1.0:1787432803.477054:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791863808 00000100:00100000:1.0:1787432803.477125:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 66 00000100:00100000:1.0:1787432803.477138:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+18:12347:x1874258791863808:12345-192.168.202.15@tcp:35:umount.0 00000100:00100000:1.0:1787432803.478204:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+19:12347:x1874258791863808:12345-192.168.202.15@tcp:35:umount.0 Request processed in 1063us (1289us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787432803.478215:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 66 00000100:00100000:0.0:1787432803.485011:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432803.485282:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791864064 00000100:00100000:1.0:1787432803.485296:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791864064 00000100:00100000:1.0:1787432803.485513:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 67 00000100:00100000:1.0:1787432803.485539:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+19:12347:x1874258791864064:12345-192.168.202.15@tcp:35:umount.0 00000100:00100000:1.0:1787432803.485967:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee8b542c-0113-490f-a721-62606ee0807f+20:12347:x1874258791864064:12345-192.168.202.15@tcp:35:umount.0 Request processed in 428us (965us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1787432803.485974:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 67 00000100:00100000:0.0:1787432803.496182:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432803.496262:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791864320 00000100:00100000:3.0:1787432803.496273:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791864320 00000100:00100000:3.0:1787432803.496331:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 68 00000100:00100000:3.0:1787432803.496341:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b8355f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+20:12347:x1874258791864320:12345-192.168.202.15@tcp:35:umount.0 00000100:00100000:3.0:1787432803.496865:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b8355f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+21:12347:x1874258791864320:12345-192.168.202.15@tcp:35:umount.0 Request processed in 522us (690us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1787432803.496873:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 68 00000100:00100000:0.0:1787432803.506441:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432803.506564:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791864576 00000100:00100000:3.0:1787432803.506575:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791864576 00000100:00100000:3.0:1787432803.506637:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:3.0:1787432803.506647:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+21:12347:x1874258791864576:12345-192.168.202.15@tcp:35:umount.0 00000100:00100000:3.0:1787432803.507004:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8b542c-0113-490f-a721-62606ee0807f+22:12347:x1874258791864576:12345-192.168.202.15@tcp:35:umount.0 Request processed in 357us (573us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1787432803.507012:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:0.0:1787432803.511565:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432803.511628:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432803.511683:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432803.511764:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791864704 00000100:00100000:1.0:1787432803.511775:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791864704 00000100:00100000:1.0:1787432803.511836:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791864960 00000100:00100000:1.0:1787432803.511839:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791864960 00000100:00100000:1.0:1787432803.511854:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791864832 00000100:00100000:1.0:1787432803.511857:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791864832 00000100:00100000:1.0:1787432803.511874:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:1.0:1787432803.511883:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+15:2378:x1874258791864704:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432803.511902:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432803.511924:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bba416c00/0xbcb9e331c3f0fab1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b19 expref: 15 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432803.511941:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432803.512000:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+14:2378:x1874258791864704:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 117us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432803.512007:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:1.0:1787432803.512025:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:1.0:1787432803.512031:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+13:2378:x1874258791864960:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432803.512039:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432803.512062:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935b80030c00/0xbcb9e331c3f0fc9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025be4 expref: 13 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432803.512072:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432803.512097:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+12:2378:x1874258791864960:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 67us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432803.512104:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:1.0:1787432803.512117:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:1.0:1787432803.512122:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+11:2378:x1874258791864832:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432803.512130:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432803.512140:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bba416a00/0xbcb9e331c3f0fa17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ae1 expref: 11 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432803.512147:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432803.512164:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2378:x1874258791864832:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 41us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432803.512169:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:0.0:1787432803.513099:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432803.513206:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791865344 00000100:00100000:2.0:1787432803.513215:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791865344 00000100:00100000:2.0:1787432803.513259:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 73 00000100:00100000:2.0:1787432803.513270:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+7:2374:x1874258791865344:12345-192.168.202.15@tcp:9:umount.0 00000020:00000080:2.0:1787432803.513298:0:6725:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0ffea 00000020:00010000:2.0:1787432803.513308:0:6725:0:(genops.c:1921:obd_stale_export_put()) Put export ffff935bbb06d000: total 0 00000100:00080000:2.0:1787432803.513313:0:6725:0:(import.c:65:import_set_state_nolock()) ffff935bbb06b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787432803.513368:0:6725:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:1.0:1787432803.513735:0:5854:0:(genops.c:1907:obd_stale_export_get()) Get export ffff935bbb06d000: total 0 00010000:00010000:1.0:1787432803.513771:0:5854:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff935bbb06d000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787432803.513824:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd09371d/0xbcb9e331c3f10a2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f87 expref: 5 pid: 12109 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432803.513860:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e8213ba/0xbcb9e331c3f1038d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025db9 expref: 4 pid: 12109 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432803.513877:0:5854:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff935bbb06d000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787432803.513890:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432803.513891:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432803.513893:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432803.515067:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8b542c-0113-490f-a721-62606ee0807f+2:2374:x1874258791865344:12345-192.168.202.15@tcp:9:umount.0 Request processed in 1777us (1948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432803.515095:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 73 00000100:00100000:1.0:1787432803.523876:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432803.524034:0:6726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791865472 00000100:00100000:3.0:1787432803.524044:0:6726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791865472 00000100:00100000:3.0:1787432803.524113:0:6726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 74 00000100:00100000:3.0:1787432803.524123:0:6726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+5:2374:x1874258791865472:12345-192.168.202.15@tcp:9:umount.0 00000020:00000080:3.0:1787432803.524168:0:6726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0fd89 00000100:00080000:3.0:1787432803.524179:0:6726:0:(import.c:65:import_set_state_nolock()) ffff935a8782a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787432803.524226:0:6726:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:0.0:1787432803.524244:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432803.524558:0:6726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee8b542c-0113-490f-a721-62606ee0807f+2:2374:x1874258791865472:12345-192.168.202.15@tcp:9:umount.0 Request processed in 435us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432803.524566:0:6726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 74 00000100:00100000:0.0:1787432803.556994:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432803.557177:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791866496 00000100:00100000:2.0:1787432803.557189:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791866496 00000100:00100000:2.0:1787432803.557250:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 240 00000100:00100000:2.0:1787432803.557261:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+22:2374:x1874258791866496:12345-192.168.202.15@tcp:39:umount.0 00000020:00000080:2.0:1787432803.557295:0:5867:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0fa25 00000020:00010000:2.0:1787432803.557312:0:5867:0:(genops.c:1921:obd_stale_export_put()) Put export ffff935a84b90800: total 0 00000100:00080000:2.0:1787432803.557317:0:5867:0:(import.c:65:import_set_state_nolock()) ffff935bbabe2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787432803.557366:0:5867:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1787432803.557807:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8b542c-0113-490f-a721-62606ee0807f+21:2374:x1874258791866496:12345-192.168.202.15@tcp:39:umount.0 Request processed in 544us (819us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787432803.557815:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 240 00000020:00010000:0.0:1787432803.558456:0:11210:0:(genops.c:1907:obd_stale_export_get()) Get export ffff935a84b90800: total 0 00010000:00010000:0.0:1787432803.558523:0:11210:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff935a84b90800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787432803.558559:0:11210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:0.0:1787432803.558563:0:11210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432803.558572:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155600/0xbcb9e331c3f109ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f72 expref: 20 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432803.558593:0:11210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a200) 00010000:00010000:0.0:1787432803.558596:0:11210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787432803.558614:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155c00/0xbcb9e331c3f103ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025dd5 expref: 19 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432803.558630:0:11210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff935b8304a100) 00010000:00010000:0.0:1787432803.558632:0:11210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432803.558637:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210600/0xbcb9e331c3f0fd0b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bf9 expref: 18 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432803.558708:0:11210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:0.0:1787432803.558711:0:11210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432803.558715:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e800/0xbcb9e331c3f1034e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025da4 expref: 17 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432803.558729:0:11210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff935ba2a69500) 00010000:00010000:0.0:1787432803.558731:0:11210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787432803.558735:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f0fcef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bf2 expref: 16 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432803.558750:0:11210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:0.0:1787432803.558752:0:11210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787432803.558755:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10378 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025db2 expref: 15 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432803.558765:0:11210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:0.0:1787432803.558766:0:11210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787432803.558769:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cee00/0xbcb9e331c3f10a16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f80 expref: 14 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432803.558780:0:11210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:0.0:1787432803.558787:0:11210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787432803.558791:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2155000/0xbcb9e331c3f1004c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ce0 expref: 13 pid: 8110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432803.558805:0:11210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:0.0:1787432803.558807:0:11210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787432803.558811:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f1040b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025ddc expref: 12 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432803.558821:0:11210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff935b952e8200) 00010000:00010000:0.0:1787432803.558824:0:11210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787432803.558826:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f106ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025eae expref: 11 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432803.558842:0:11210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff935b9838f000) 00010000:00010000:0.0:1787432803.558844:0:11210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787432803.558848:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1026e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025d6c expref: 10 pid: 6929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432803.558860:0:11210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff935b8304a000) 00010000:00010000:0.0:1787432803.558862:0:11210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787432803.558865:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bc2154e00/0xbcb9e331c3f0fd5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025c0e expref: 9 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432803.558877:0:11210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff935b952e8900) 00010000:00010000:0.0:1787432803.558879:0:11210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787432803.558883:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cfe00/0xbcb9e331c3f1090c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f3a expref: 8 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432803.558905:0:11210:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff935a84b90800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1787432803.558920:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432803.558922:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432803.558924:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432804.469957:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432805.496518:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432805.622149:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812818432:0@lo:400:kworker.0 00000100:00100000:3.0:1787432805.622241:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432805.622322:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812818944:0@lo:400:kworker.0 00000100:00100000:3.0:1787432805.622346:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432805.622385:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787432805.622391:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3332:1874258812818560:0@lo:400:kworker.0 00000100:00100000:3.0:1787432805.622410:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432805.622440:0:6724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812818944 00000100:00100000:3.0:1787432805.622446:0:6724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812818944 00000100:00100000:3.0:1787432805.622512:0:6724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787432805.622521:0:6724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812818944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432805.622565:0:6724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812818944:12345-0@lo:400:kworker.0 Request processed in 46us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432805.622572:0:6724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787432805.622605:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812818432 00000100:00100000:3.0:1787432805.622608:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812818432 00000100:00100000:3.0:1787432805.622641:0:6929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812818560 00000100:00100000:3.0:1787432805.622643:0:6929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812818560 00000100:00100000:3.0:1787432805.622680:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787432805.622686:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812818432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432805.622717:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812818432:12345-0@lo:400:kworker.0 Request processed in 32us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432805.622723:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787432805.622733:0:6929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787432805.622738:0:6929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1874258812818560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432805.622756:0:6929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1874258812818560:12345-0@lo:400:kworker.0 Request processed in 18us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432805.622761:0:6929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:3.0:1787432805.622793:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432805.622797:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787432805.622831:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3332:1874258812818560:0@lo:400:kworker.0 00000100:00100000:3.0:1787432805.622840:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812818432:0@lo:400:kworker.0 00000100:00100000:3.0:1787432805.622847:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812818944:0@lo:400:kworker.0 00000100:00100000:0.0:1787432805.623049:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812818688:0@lo:400:kworker.0 00000100:00100000:0.0:1787432805.623078:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432805.623105:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787432805.623111:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812818304:0@lo:400:kworker.0 00000100:00100000:0.0:1787432805.623135:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432805.623154:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812818816:0@lo:400:kworker.0 00000100:00100000:0.0:1787432805.623171:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432805.623192:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812818304 00000100:00100000:0.0:1787432805.623195:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812818304 00000100:00100000:0.0:1787432805.623219:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787432805.623224:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812818304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432805.623252:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3330:x1874258812818304:12345-0@lo:400:kworker.0 Request processed in 28us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432805.623257:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787432805.623282:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812818816 00000100:00100000:0.0:1787432805.623285:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812818816 00000100:00100000:0.0:1787432805.623310:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787432805.623315:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812818816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432805.623339:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812818816:12345-0@lo:400:kworker.0 Request processed in 24us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432805.623354:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:0.0:1787432805.623421:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432805.623449:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812818304:0@lo:400:kworker.0 00000100:00100000:0.0:1787432805.623469:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812818816:0@lo:400:kworker.0 00000100:00100000:3.0:1787432805.623967:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812818688 00000100:00100000:3.0:1787432805.623973:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812818688 00000100:00100000:3.0:1787432805.624016:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787432805.624023:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812818688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432805.624064:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812818688:12345-0@lo:400:kworker.0 Request processed in 42us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432805.624070:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1787432805.624489:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432805.624523:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812818688:0@lo:400:kworker.0 00000100:00100000:0.0:1787432806.040580:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432806.040687:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791866624 00000100:00100000:1.0:1787432806.040707:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791866624 00000100:00100000:1.0:1787432806.040782:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:1.0:1787432806.040794:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2377:x1874258791866624:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432806.040811:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432806.040833:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bba416000/0xbcb9e331c3f0faf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b2e expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432806.040853:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432806.040912:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+9:2377:x1874258791866624:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 120us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432806.040920:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:1.0:1787432806.044689:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432806.044779:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432806.056650:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791866752 00000100:00100000:3.0:1787432806.056680:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791866752 00000100:00100000:3.0:1787432806.056747:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791866880 00000100:00100000:3.0:1787432806.056751:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791866880 00000100:00100000:3.0:1787432806.056792:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:3.0:1787432806.056803:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b909bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+10:2378:x1874258791866752:12345-192.168.202.15@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787432806.056818:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:3.0:1787432806.056821:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432806.056845:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bba416600/0xbcb9e331c3f0fafe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b58 expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432806.056856:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791867136 00000100:00100000:1.0:1787432806.056862:0:5869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791867136 00010000:00010000:3.0:1787432806.056864:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432806.056912:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 241 00000100:00100000:3.0:1787432806.056920:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b909bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+9:2378:x1874258791866752:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 118us (12260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432806.056923:0:5869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+6:2374:x1874258791867136:12345-192.168.202.15@tcp:39:umount.0 00000100:00100000:3.0:1787432806.056935:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 22 00000020:00000080:1.0:1787432806.056963:0:5869:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0fb0c 00000020:00010000:1.0:1787432806.056974:0:5869:0:(genops.c:1921:obd_stale_export_put()) Put export ffff935bbb47a000: total 0 00000100:00080000:1.0:1787432806.056980:0:5869:0:(import.c:65:import_set_state_nolock()) ffff935bbb47b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787432806.057017:0:5869:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1787432806.057084:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:3.0:1787432806.057105:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+8:2378:x1874258791866880:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432806.057125:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432806.057136:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bc2167a00/0xbcb9e331c3f0fc94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025bdd expref: 8 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432806.057146:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432806.057171:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+7:2378:x1874258791866880:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 67us (12393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432806.057177:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 23 00000020:00010000:3.0:1787432806.057228:0:11210:0:(genops.c:1907:obd_stale_export_get()) Get export ffff935bbb47a000: total 0 00010000:00010000:3.0:1787432806.057232:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432806.057273:0:11210:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff935bbb47a000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787432806.057296:0:11210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b8304a200) 00010000:00010000:3.0:1787432806.057300:0:11210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432806.057306:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10a39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025f8e expref: 5 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432806.057326:0:11210:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff935bbb47a000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787432806.057339:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787432806.057344:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787432806.057354:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432806.057357:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432806.057587:0:5869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c1bafcc-88f0-4bc2-9523-0dc619fa83f5+3:2374:x1874258791867136:12345-192.168.202.15@tcp:39:umount.0 Request processed in 667us (771us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1787432806.057595:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 241 00000100:00100000:0.0:1787432806.075132:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432806.075207:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791867392 00000100:00100000:3.0:1787432806.075219:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791867392 00000100:00100000:3.0:1787432806.075279:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 308 00000100:00100000:3.0:1787432806.075290:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b907e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+7:2374:x1874258791867392:12345-192.168.202.15@tcp:251:umount.0 00000020:00000080:3.0:1787432806.075389:0:5861:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0fa02 00000020:00010000:3.0:1787432806.075398:0:5861:0:(genops.c:1921:obd_stale_export_put()) Put export ffff935a85a84000: total 0 00000100:00080000:3.0:1787432806.075403:0:5861:0:(import.c:65:import_set_state_nolock()) ffff935a85a82000 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1787432806.075464:0:5854:0:(genops.c:1907:obd_stale_export_get()) Get export ffff935a85a84000: total 0 00000100:00100000:3.0:1787432806.075496:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b907e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ddbb8f34-e22a-4617-a2bc-6bdb0784521d+3:2374:x1874258791867392:12345-192.168.202.15@tcp:251:umount.0 Request processed in 207us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432806.075506:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 308 00010000:00010000:1.0:1787432806.075519:0:5854:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff935a85a84000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787432806.075565:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bb5210400/0xbcb9e331c3f0fab8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025b20 expref: 2 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432806.075581:0:5854:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff935a85a84000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787432806.075598:0:5854:0:(genops.c:885:class_export_put()) final put ffff935a85a84000/ddbb8f34-e22a-4617-a2bc-6bdb0784521d 00010000:00010000:1.0:1787432806.075621:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432806.075623:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432806.075626:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787432806.075789:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff935a85a84000/ddbb8f34-e22a-4617-a2bc-6bdb0784521d for MGS 00000020:00000080:0.0:1787432806.075966:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935a85a82000 for MGS 00000100:00100000:3.0:1787432806.133973:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787432806.134000:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812819072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432806.134074:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432806.134576:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432806.134589:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812819200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432806.134625:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432806.135105:0:9985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812819072 00000100:00100000:0.0:1787432806.135114:0:9985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812819072 00000100:00100000:0.0:1787432806.135170:0:9985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812819200 00000100:00100000:0.0:1787432806.135173:0:9985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812819200 00000100:00100000:0.0:1787432806.135191:0:9985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787432806.135203:0:9985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812819072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787432806.135240:0:9985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787432806.135336:0:9985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812819072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432806.135344:0:9985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787432806.135376:0:9985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787432806.135383:0:9985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812819200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787432806.135402:0:9985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787432806.135463:0:9985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812819200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432806.135485:0:9985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787432806.135536:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812819200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432806.135948:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812819072:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787432806.518504:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787432807.255266:0:6749:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ee8b542c-0113-490f-a721-62606ee0807f 00000020:00000080:3.0:1787432807.255280:0:6749:0:(genops.c:885:class_export_put()) final put ffff935a8782e800/ee8b542c-0113-490f-a721-62606ee0807f 00000020:00000080:3.0:1787432807.255315:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff935a8782e800/ee8b542c-0113-490f-a721-62606ee0807f for lustre-OST0000 00000020:00000080:3.0:1787432807.255379:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935a8782a000 for lustre-OST0000 00000001:00100000:2.0:1787432807.268262:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ee8b542c-0113-490f-a721-62606ee0807f 00000020:00000080:2.0:1787432807.268275:0:7682:0:(genops.c:885:class_export_put()) final put ffff935bbb06d000/ee8b542c-0113-490f-a721-62606ee0807f 00000020:00000080:2.0:1787432807.268309:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff935bbb06d000/ee8b542c-0113-490f-a721-62606ee0807f for lustre-OST0001 00000020:00000080:2.0:1787432807.268376:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935bbb06b800 for lustre-OST0001 00000001:00100000:2.0:1787432807.284121:0:5889:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5c1bafcc-88f0-4bc2-9523-0dc619fa83f5 00000001:00080000:2.0:1787432807.284143:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1787432807.284149:0:5889:0:(genops.c:885:class_export_put()) final put ffff935bbb47a000/5c1bafcc-88f0-4bc2-9523-0dc619fa83f5 00000001:00080000:2.0:1787432807.284166:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00000080:2.0:1787432807.284183:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff935bbb47a000/5c1bafcc-88f0-4bc2-9523-0dc619fa83f5 for lustre-MDT0000 00000001:00100000:3.0:1787432807.287883:0:5889:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ee8b542c-0113-490f-a721-62606ee0807f 00000001:00080000:3.0:1787432807.287910:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1787432807.287929:0:5889:0:(genops.c:885:class_export_put()) final put ffff935a84b90800/ee8b542c-0113-490f-a721-62606ee0807f 00000020:00000080:2.0:1787432807.288068:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935bbb47b000 for lustre-MDT0000 00000020:00000080:2.0:1787432807.288158:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff935a84b90800/ee8b542c-0113-490f-a721-62606ee0807f for lustre-MDT0000 00000020:00000080:2.0:1787432807.288250:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935bbabe2800 for lustre-MDT0000 00010000:00010000:3.0:1787432807.541830:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787432807.836637:0:12957:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787432807.855831:0:12957:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787432807.855905:0:12957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba416e00/0xbcb9e331c3f0fa87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa8e expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432807.855923:0:12957:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba416e00/0xbcb9e331c3f0fa87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fa8e expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432807.855931:0:12957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba416e00/0xbcb9e331c3f0fa87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0fa8e expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432807.855938:0:12957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff935bba416e00/0xbcb9e331c3f0fa87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0fa8e expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432807.855962:0:12957:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787432807.855969:0:12957:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787432807.856002:0:12957:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787432807.856008:0:12957:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787432807.856017:0:12957:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787432807.856052:0:12957:0:(import.c:65:import_set_state_nolock()) ffff935b90918000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787432807.856165:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874258812819328:0@lo:39:umount.0 00000100:00100000:3.0:1787432807.856261:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787432807.856368:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432807.856377:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bba416e00/0xbcb9e331c3f0fa87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0fa8e expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.856396:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba416e00 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:1.0:1787432807.856401:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bba416e00/0xbcb9e331c3f0fa87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0fa8e expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.856411:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bba416e00/0xbcb9e331c3f0fa87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xbcb9e331c3f0fa8e expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432807.856419:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bba416e00/0xbcb9e331c3f0fa87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xbcb9e331c3f0fa8e expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432807.856424:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787432807.856427:0:5854:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787432807.856430:0:5854:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787432807.856475:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bba416e00/0xbcb9e331c3f0fa87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbcb9e331c3f0fa8e expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.856482:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432807.856506:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bba416e00/0xbcb9e331c3f0fa87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbcb9e331c3f0fa8e expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.856539:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bba416e00/0xbcb9e331c3f0fa87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbcb9e331c3f0fa8e expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.856553:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432807.856555:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432807.856557:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432807.856582:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812819456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432807.856619:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432807.857646:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812819456 00000100:00100000:3.0:1787432807.857681:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812819456 00000100:00100000:3.0:1787432807.857753:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787432807.857765:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+19:3331:x1874258812819456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787432807.857783:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432807.857806:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bb5211800/0xbcb9e331c3f0fa8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbcb9e331c3f0fa87 expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432807.857825:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432807.857876:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:3331:x1874258812819456:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432807.857898:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787432807.858789:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812819456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432807.862692:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812819328 00000100:00100000:0.0:1787432807.862710:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812819328 00000100:00100000:1.0:1787432807.863029:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787432807.863043:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874258812819328:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787432807.863087:0:5867:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f811 00000100:00080000:1.0:1787432807.863099:0:5867:0:(import.c:65:import_set_state_nolock()) ffff935bbd7b4000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787432807.863246:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3329:x1874258812819328:12345-0@lo:39:umount.0 Request processed in 206us (6985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432807.863253:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1787432807.863283:0:5867:0:(genops.c:885:class_export_put()) final put ffff935bbd7b0800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787432807.863311:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935bbd7b0800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787432807.863361:0:12223:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935bbd7b4000 for lustre-MDT0000 00000100:00080000:2.0:1787432807.863457:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935b90918000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787432807.863472:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874258812819328:0@lo:39:umount.0 00010000:00010000:3.0:1787432807.863845:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787432807.864097:0:12957:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787432807.864102:0:12957:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787432807.864109:0:12957:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787432807.865798:0:12957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0fa95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa9c expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432807.865842:0:12957:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0fa95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fa9c expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432807.865850:0:12957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0fa95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0fa9c expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432807.865857:0:12957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0fa95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0fa9c expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.865992:0:12957:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432807.866004:0:12957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2166400/0xbcb9e331c3f0f9bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f9c3 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.866012:0:12957:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2166400/0xbcb9e331c3f0f9bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f9c3 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.866032:0:12957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2166400/0xbcb9e331c3f0f9bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0f9c3 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.866038:0:12957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff935bc2166400/0xbcb9e331c3f0f9bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0f9c3 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432807.866068:0:11210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787432807.866077:0:11210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0fa95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0fa9c expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432807.866085:0:11210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031200 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:3.0:1787432807.866089:0:11210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0fa95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0fa9c expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432807.866099:0:11210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0fa95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xbcb9e331c3f0fa9c expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432807.866107:0:11210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0fa95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xbcb9e331c3f0fa9c expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432807.866115:0:11210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787432807.866118:0:11210:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787432807.866163:0:11210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0fa95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbcb9e331c3f0fa9c expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432807.866171:0:11210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787432807.866233:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812819584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432807.866325:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432807.866467:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812819584 00000100:00100000:2.0:1787432807.866478:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812819584 00000100:00100000:2.0:1787432807.866542:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787432807.866554:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+18:3332:x1874258812819584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432807.866580:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432807.866598:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bba416400/0xbcb9e331c3f0fa9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbcb9e331c3f0fa95 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432807.866618:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432807.866821:0:12957:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432807.866836:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432807.866842:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bc2166400/0xbcb9e331c3f0f9bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0f9c3 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.866849:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2166400 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:1.0:1787432807.866853:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bc2166400/0xbcb9e331c3f0f9bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0f9c3 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.866861:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bc2166400/0xbcb9e331c3f0f9bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbcb9e331c3f0f9c3 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432807.866868:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bc2166400/0xbcb9e331c3f0f9bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbcb9e331c3f0f9c3 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432807.866873:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787432807.866876:0:5854:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787432807.866879:0:5854:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787432807.866899:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bc2166400/0xbcb9e331c3f0f9bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbcb9e331c3f0f9c3 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.866905:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787432807.866961:0:11210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0fa95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbcb9e331c3f0fa9c expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432807.866968:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935b80031200/0xbcb9e331c3f0fa95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbcb9e331c3f0fa9c expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432807.866981:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432807.866983:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432807.866995:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432807.867141:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:3332:x1874258812819584:12345-0@lo:103:ldlm_bl.0 Request processed in 588us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432807.867151:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787432807.867183:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812819712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432807.867220:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432807.867302:0:8489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812819712 00000100:00100000:3.0:1787432807.867308:0:8489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812819712 00000100:00100000:3.0:1787432807.867354:0:8489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787432807.867362:0:8489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+17:3333:x1874258812819712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787432807.867372:0:8489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432807.867397:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bc2167c00/0xbcb9e331c3f0f9c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbcb9e331c3f0f9bc expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432807.867416:0:8489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432807.867461:0:8489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:3333:x1874258812819712:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432807.867468:0:8489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787432807.867602:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812819712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432807.867812:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3332:1874258812819584:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432807.867917:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bc2166400/0xbcb9e331c3f0f9bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbcb9e331c3f0f9c3 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.867936:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bc2166400/0xbcb9e331c3f0f9bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbcb9e331c3f0f9c3 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.867953:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432807.867956:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432807.867957:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432807.867990:0:12957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bbaa5ee00/0xbcb9e331c3f0fcbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fcc5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.868000:0:12957:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bbaa5ee00/0xbcb9e331c3f0fcbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fcc5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.868007:0:12957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bbaa5ee00/0xbcb9e331c3f0fcbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0fcc5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.868013:0:12957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff935bbaa5ee00/0xbcb9e331c3f0fcbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0fcc5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.868063:0:12957:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432807.868071:0:12957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bb5211c00/0xbcb9e331c3f0f770 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0f777 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.868078:0:12957:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bb5211c00/0xbcb9e331c3f0f770 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0f777 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.868084:0:12957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bb5211c00/0xbcb9e331c3f0f770 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0f777 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.868090:0:12957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff935bb5211c00/0xbcb9e331c3f0f770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0f777 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432807.868124:0:5855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787432807.868130:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bbaa5ee00/0xbcb9e331c3f0fcbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0fcc5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432807.868137:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5ee00 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:3.0:1787432807.868141:0:5855:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bbaa5ee00/0xbcb9e331c3f0fcbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0fcc5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432807.868149:0:5855:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bbaa5ee00/0xbcb9e331c3f0fcbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbcb9e331c3f0fcc5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432807.868157:0:5855:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bbaa5ee00/0xbcb9e331c3f0fcbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbcb9e331c3f0fcc5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432807.868162:0:5855:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787432807.868165:0:5855:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787432807.868168:0:5855:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787432807.868197:0:5855:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bbaa5ee00/0xbcb9e331c3f0fcbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbcb9e331c3f0fcc5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432807.868204:0:5855:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787432807.868251:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812819840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432807.868287:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432807.868352:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812819840 00000100:00100000:2.0:1787432807.868357:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812819840 00000100:00100000:2.0:1787432807.868406:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787432807.868414:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+16:3330:x1874258812819840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432807.868423:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432807.868449:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bbaa5ec00/0xbcb9e331c3f0fcc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbcb9e331c3f0fcbe expref: 16 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432807.868472:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432807.868779:0:12957:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787432807.868786:0:12957:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1787432807.868791:0:12957:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787432807.868829:0:12957:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787432807.868834:0:12957:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787432807.868839:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432807.868846:0:12957:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1787432807.868852:0:12957:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff935a8524d800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787432807.868859:0:12957:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff935a84bb2000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787432807.868864:0:12957:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff935b879b3370) has exports, disconnecting them 00000020:00080000:1.0:1787432807.868870:0:12957:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff935a8524d800), last request at 1787432805 00000020:00000080:1.0:1787432807.868878:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f984 00000100:00080000:1.0:1787432807.868899:0:12957:0:(import.c:65:import_set_state_nolock()) ffff935a8524c800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787432807.868946:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432807.868951:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bb5211c00/0xbcb9e331c3f0f770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0f777 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.868957:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bb5211c00 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:1.0:1787432807.868960:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bb5211c00/0xbcb9e331c3f0f770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0f777 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.868967:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bb5211c00/0xbcb9e331c3f0f770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbcb9e331c3f0f777 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432807.868973:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bb5211c00/0xbcb9e331c3f0f770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbcb9e331c3f0f777 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432807.868979:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787432807.868988:0:5854:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787432807.868990:0:5854:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787432807.869011:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bb5211c00/0xbcb9e331c3f0f770 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbcb9e331c3f0f777 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.869017:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787432807.869217:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bbaa5ee00/0xbcb9e331c3f0fcbe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbcb9e331c3f0fcc5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432807.869225:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bbaa5ee00/0xbcb9e331c3f0fcbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbcb9e331c3f0fcc5 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432807.869234:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432807.869236:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432807.869238:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432807.869245:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432807.869256:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812819968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787432807.869295:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432807.869396:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:3330:x1874258812819840:12345-0@lo:103:ldlm_bl.0 Request processed in 982us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432807.869406:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787432807.869426:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812819968 00000100:00100000:2.0:1787432807.869441:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812819968 00000100:00100000:2.0:1787432807.869475:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787432807.869482:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+15:3331:x1874258812819968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432807.869491:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432807.869503:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935b80030800/0xbcb9e331c3f0f777 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbcb9e331c3f0f770 expref: 15 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432807.869518:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432807.869714:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3330:1874258812819840:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432807.869814:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bb5211c00/0xbcb9e331c3f0f770 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbcb9e331c3f0f777 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.869822:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bb5211c00/0xbcb9e331c3f0f770 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbcb9e331c3f0f777 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432807.869837:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432807.869839:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432807.869841:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787432807.869860:0:12957:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff935a8524d800): rc 0 00000020:00000080:1.0:1787432807.869864:0:12957:0:(genops.c:885:class_export_put()) final put ffff935a8524d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787432807.869879:0:12957:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff935a84bb2000), last request at 1787432805 00000020:00000080:1.0:1787432807.869884:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f8b9 00000100:00080000:1.0:1787432807.869892:0:12957:0:(import.c:65:import_set_state_nolock()) ffff935a84bb5800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787432807.869908:0:12957:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff935a84bb2000): rc 0 00000020:00000080:1.0:1787432807.869911:0:12957:0:(genops.c:885:class_export_put()) final put ffff935a84bb2000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1787432807.869919:0:12957:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9ea403c4fae0 00000100:00080000:1.0:1787432807.869945:0:12957:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787432807.869948:0:12957:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1787432807.869964:0:12957:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787432807.870055:0:12957:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787432807.870075:0:12957:0:(import.c:65:import_set_state_nolock()) ffff935b911eb800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787432807.870090:0:12957:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787432807.870092:0:12957:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1787432807.870102:0:12957:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787432807.870176:0:12957:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787432807.870186:0:12957:0:(import.c:65:import_set_state_nolock()) ffff935b9089b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787432807.870222:0:12957:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff935b879b3370) has no exports 00000100:00100000:2.0:1787432807.871059:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2afcd650-d22d-4efa-b57b-1cd88d01ee9e+14:3331:x1874258812819968:12345-0@lo:103:ldlm_bl.0 Request processed in 1572us (1757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432807.871071:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000020:00000080:2.0:1787432807.871112:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff935a8524d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787432807.871174:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff935a84bb2000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787432807.871205:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935a8524c800 for lustre-MDT0000 00000020:00000080:2.0:1787432807.871211:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935a84bb5800 for lustre-MDT0000 00000100:00100000:2.0:1787432807.871229:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812820096:0@lo:9:umount.0 00000100:00100000:2.0:1787432807.871291:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432807.871321:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812820224:0@lo:9:umount.0 00000100:00100000:2.0:1787432807.871345:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432807.871494:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812820096 00000100:00100000:2.0:1787432807.871502:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812820096 00000100:00100000:2.0:1787432807.871611:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812820224 00000100:00100000:2.0:1787432807.871615:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812820224 00000100:00100000:3.0:1787432807.871749:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812819968:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787432807.871780:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787432807.871880:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432807.871885:0:5863:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787432807.872056:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787432807.872066:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3329:x1874258812820096:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787432807.872098:0:8446:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f906 00000100:00080000:2.0:1787432807.872108:0:8446:0:(import.c:65:import_set_state_nolock()) ffff935b911ec800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787432807.872148:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1787432807.872759:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3329:x1874258812820096:12345-0@lo:9:umount.0 Request processed in 693us (1466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432807.872767:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787432807.872785:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787432807.872793:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3329:x1874258812820224:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787432807.872809:0:8446:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f9ed 00000100:00080000:2.0:1787432807.872815:0:8446:0:(import.c:65:import_set_state_nolock()) ffff935a85a81000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787432807.872837:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1787432807.873042:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3329:x1874258812820224:12345-0@lo:9:umount.0 Request processed in 250us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432807.873049:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:2.0:1787432807.873078:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787432807.873114:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935b911eb800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787432807.873131:0:3329:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787432807.873134:0:3329:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787432807.873137:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812820096:0@lo:9:umount.0 00000100:00080000:2.0:1787432807.873151:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935b9089b800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787432807.873160:0:3329:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787432807.873162:0:3329:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787432807.873164:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812820224:0@lo:9:umount.0 00010000:00010000:2.0:1787432807.873207:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787432807.881099:0:12957:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff935b879b3370) has no exports 00000020:00000080:2.0:1787432807.952700:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f7cb 00000020:00000080:2.0:1787432807.952718:0:12957:0:(genops.c:885:class_export_put()) final put ffff935bbb685000/lustre-QMT0000_UUID 00000020:01000000:2.0:1787432807.952737:0:12957:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787432807.952825:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787432807.952846:0:12957:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787432807.952853:0:12957:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff935b9062b370) has no exports 00000020:00000080:1.0:1787432807.953113:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935bbb685000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787432807.954200:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f7c4 00000020:00000080:3.0:1787432807.954214:0:12957:0:(genops.c:885:class_export_put()) final put ffff935bbd7b7000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787432807.954336:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935bbd7b7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787432807.954552:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787432807.954565:0:12957:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787432807.954582:0:12957:0:(genops.c:885:class_export_put()) final put ffff935b98a35800/lustre-QMT0000_UUID 00000020:00000080:3.0:1787432807.954584:0:12957:0:(genops.c:844:class_export_destroy()) destroying export ffff935b98a35800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787432807.954598:0:12957:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1787432807.955027:0:12957:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff935bb9cae4e0 - data ffff935bc0e55e58/ffff935a84a41000 00000020:01000000:3.0:1787432807.955203:0:12957:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff935ba078cf00 - data ffff935bb73ef1b0/ffff935b910d5c00 00000001:00000004:1.0:1787432807.970647:0:12957:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1787432808.062246:0:12957:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787432808.062257:0:12957:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787432808.062503:0:12957:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787432808.062507:0:12957:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787432808.063922:0:6927:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787432808.063931:0:6927:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1787432808.063944:0:6927:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787432808.067093:0:12957:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787432808.067104:0:12957:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1787432808.067162:0:12957:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787432808.067166:0:12957:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787432808.071063:0:8107:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787432808.071074:0:8107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1787432808.071089:0:8107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787432808.149274:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f793 00000020:00000080:1.0:1787432808.149292:0:12957:0:(genops.c:885:class_export_put()) final put ffff935bbb3e0000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787432808.152742:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935bbb3e0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787432808.156264:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f7a8 00000020:00000080:1.0:1787432808.156288:0:12957:0:(genops.c:885:class_export_put()) final put ffff935bbb3e0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787432808.156367:0:12957:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787432808.156462:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432808.156477:0:12957:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787432808.156483:0:12957:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff935b879b4d28) has no exports 00000004:01000000:1.0:1787432808.157100:0:12957:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787432808.157115:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f9e6 00000020:00000080:1.0:1787432808.157122:0:12957:0:(genops.c:885:class_export_put()) final put ffff935a8524f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787432808.157280:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935bbb3e0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787432808.157467:0:12957:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787432808.157474:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432808.157485:0:12957:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787432808.157488:0:12957:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff935b91a84d28) has no exports 00000020:00000080:1.0:1787432808.157498:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f9df 00000020:00000080:1.0:1787432808.157504:0:12957:0:(genops.c:885:class_export_put()) final put ffff935b9089d000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787432808.157529:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935a8524f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1787432808.158192:0:12957:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787432808.158199:0:12957:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787432808.158204:0:12957:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1787432808.158212:0:12957:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787432808.158214:0:12957:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787432808.158273:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935b9089d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787432808.158503:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432808.158528:0:12957:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787432808.158535:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f8ff 00000020:00000080:1.0:1787432808.158542:0:12957:0:(genops.c:885:class_export_put()) final put ffff935b911e9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787432808.158577:0:12223:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935b9089b800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787432808.158585:0:12223:0:(genops.c:885:class_export_put()) final put ffff935a84b92800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787432808.158588:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935a84b92800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787432808.158595:0:12223:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787432808.158918:0:12957:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787432808.158924:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432808.158929:0:12957:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787432808.158932:0:12957:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff935b8683cd28) has no exports 00000020:00000080:1.0:1787432808.158938:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f8f8 00000020:00000080:1.0:1787432808.158943:0:12957:0:(genops.c:885:class_export_put()) final put ffff935b911ed000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1787432808.159327:0:12957:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787432808.159332:0:12957:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787432808.159335:0:12957:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1787432808.159341:0:12957:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:2.0:1787432808.159519:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935b911e9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787432808.159529:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935b911ed000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1787432808.159557:0:12957:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787432808.159778:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432808.159786:0:12957:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787432808.159894:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432808.159899:0:12957:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787432808.159905:0:12957:0:(genops.c:885:class_export_put()) final put ffff935ba6bca000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787432808.159907:0:12957:0:(genops.c:844:class_export_destroy()) destroying export ffff935ba6bca000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787432808.159919:0:12957:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787432808.160117:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f7af 00000020:00000080:1.0:1787432808.160124:0:12957:0:(genops.c:885:class_export_put()) final put ffff935bbb3e2800/lustre-MDD0000_UUID 00000020:00000080:2.0:1787432808.160154:0:12223:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935b911eb800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787432808.160162:0:12223:0:(genops.c:885:class_export_put()) final put ffff935b98a85000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787432808.160164:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935b98a85000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787432808.160169:0:12223:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787432808.160320:0:12957:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787432808.160326:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432808.160331:0:12957:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787432808.160335:0:12957:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff935b879b19b8) has no exports 00000020:00000080:1.0:1787432808.160518:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432808.160523:0:12957:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787432808.160528:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f7b6 00000020:00000080:1.0:1787432808.160534:0:12957:0:(genops.c:885:class_export_put()) final put ffff935bbb3e1000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787432808.160554:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935bbb3e2800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787432808.160558:0:12223:0:(genops.c:885:class_export_put()) final put ffff935bbb3e5000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787432808.160586:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935bbb3e5000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787432808.160591:0:12223:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1787432808.161089:0:12957:0:(tgt_mount.c:187:server_put_mount()) put mount ffff935b90e92000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787432808.161104:0:12957:0:(obd_mount.c:710:lustre_put_lsi()) put ffff935b90e92000 3 00000020:01000004:1.0:1787432808.161108:0:12957:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff935b90e92000 from lustre-MDT0000 00000020:00000080:1.0:1787432808.161133:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432808.161138:0:12957:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787432808.161142:0:12957:0:(genops.c:885:class_export_put()) final put ffff935bbb3e7000/lustre-MDT0000_UUID 00000020:00000080:1.0:1787432808.161144:0:12957:0:(genops.c:844:class_export_destroy()) destroying export ffff935bbb3e7000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787432808.161154:0:12957:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787432808.161186:0:12957:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1787432808.161190:0:12957:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787432808.161194:0:12957:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787432808.161197:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432808.161201:0:12957:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787432808.161209:0:12957:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff935b87978800 2afcd650-d22d-4efa-b57b-1cd88d01ee9e 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787432808.161214:0:12957:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff935b9062cd28) has exports, disconnecting them 00000020:00080000:1.0:1787432808.161219:0:12957:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff935b87978800), last request at 1787432568 00000020:00000080:1.0:1787432808.161237:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f754 00000020:00010000:1.0:1787432808.161242:0:12957:0:(genops.c:1921:obd_stale_export_put()) Put export ffff935b87978800: total 1 00000100:00080000:1.0:1787432808.161247:0:12957:0:(import.c:65:import_set_state_nolock()) ffff935b8797f000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787432808.161276:0:12957:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff935b87978800): rc 0 00000020:00080000:1.0:1787432808.161281:0:12957:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff935b9062cd28) has no exports 00000020:00010000:0.0:1787432808.161471:0:5855:0:(genops.c:1907:obd_stale_export_get()) Get export ffff935b87978800: total 1 00010000:00010000:0.0:1787432808.161516:0:5855:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff935b87978800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787432808.161550:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935b80030200/0xbcb9e331c3f0fa80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbcb9e331c3f0fa79 expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432808.161594:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935b80030400/0xbcb9e331c3f0faaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbcb9e331c3f0faa3 expref: 8 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432808.161605:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bc2166800/0xbcb9e331c3f0fca9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbcb9e331c3f0fca2 expref: 7 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432808.161617:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f0fcb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbcb9e331c3f0fcb0 expref: 6 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432808.161632:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bb5210a00/0xbcb9e331c3f0f86c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbcb9e331c3f0f865 expref: 5 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432808.161647:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bb5210200/0xbcb9e331c3f0fa56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbcb9e331c3f0fa4f expref: 4 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432808.161677:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bb5211600/0xbcb9e331c3f0fa64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbcb9e331c3f0fa5d expref: 3 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432808.161691:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935b80031000/0xbcb9e331c3f0fa72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbcb9e331c3f0fa6b expref: 2 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432808.161704:0:5855:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff935b87978800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1787432808.161720:0:5855:0:(genops.c:885:class_export_put()) final put ffff935b87978800/2afcd650-d22d-4efa-b57b-1cd88d01ee9e 00000100:00100000:1.0:1787432808.161798:0:5862:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff935b87494200:5862] 2 exiting: rc = 0 00000020:00000080:2.0:1787432808.162167:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935bbb3e1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1787432808.162235:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432808.162238:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432808.162240:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432808.162273:0:5860:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff935b90e9fc00:5860] 0 exiting: rc = 1 00000020:00000080:2.0:1787432808.162333:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935b87978800/2afcd650-d22d-4efa-b57b-1cd88d01ee9e for MGS 00000020:00000080:2.0:1787432808.162558:0:12223:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935b8797f000 for MGS 00000100:00100000:3.0:1787432808.167459:0:5861:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff935b90e9ec00:5861] 1 exiting: rc = 0 00000100:00100000:1.0:1787432808.167723:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167752:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167761:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167768:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167775:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167781:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167786:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167791:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167798:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167817:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167825:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167854:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167861:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167868:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167874:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167880:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167887:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167893:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167902:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167909:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167916:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167922:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167929:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167936:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167942:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167948:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167955:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167961:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167967:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167973:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167979:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167987:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167992:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.167998:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168004:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168009:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168014:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168020:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168025:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168030:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168036:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168041:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168046:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168051:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168057:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168062:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168075:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168081:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168086:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168093:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168098:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168106:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168112:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168118:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168124:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168131:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168137:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168144:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168149:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168156:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168163:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168170:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168176:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.168181:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1787432808.168779:0:12957:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787432808.168784:0:12957:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1787432808.170271:0:12957:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff935b906dd4e0 - data ffff935b9f6de438/ffff935b9118c000 00000020:01000000:2.0:1787432808.170695:0:12957:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff935ba0560780 - data ffff935bb7381ca8/ffff935b878c3000 00000020:00000080:2.0:1787432808.171732:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f738 00000020:00000080:2.0:1787432808.171742:0:12957:0:(genops.c:885:class_export_put()) final put ffff935b98a94000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787432808.171809:0:12957:0:(tgt_mount.c:187:server_put_mount()) put mount ffff935b90e92000 from MGS, refs=2 00000020:01000004:2.0:1787432808.171814:0:12957:0:(obd_mount.c:710:lustre_put_lsi()) put ffff935b90e92000 2 00000020:01000004:2.0:1787432808.171818:0:12957:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff935b90e92000 from MGS 00000020:00000080:2.0:1787432808.171848:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787432808.171857:0:12957:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787432808.171859:0:12957:0:(genops.c:885:class_export_put()) final put ffff935b98a95800/MGS 00000020:00000080:2.0:1787432808.171863:0:12957:0:(genops.c:844:class_export_destroy()) destroying export ffff935b98a95800/MGS for MGS 00000020:01000000:2.0:1787432808.171874:0:12957:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787432808.171947:0:12957:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787432808.171952:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787432808.171959:0:12957:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787432808.171967:0:12957:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff935b9091d000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787432808.171974:0:12957:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff935b906299b8) has exports, disconnecting them 00000020:00080000:2.0:1787432808.171979:0:12957:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff935b9091d000), last request at 1787432569 00000020:00000080:2.0:1787432808.171984:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f803 00000020:00080000:2.0:1787432808.171997:0:12957:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff935b9091d000): rc 0 00000020:00000080:2.0:1787432808.172003:0:12957:0:(genops.c:885:class_export_put()) final put ffff935b9091d000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787432808.172134:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935b98a94000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787432808.172893:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935b9091d000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787432808.178748:0:12957:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787432808.178762:0:12957:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787432808.178782:0:12957:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787432808.178794:0:12957:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787432808.179074:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787432808.179086:0:12957:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787432808.179095:0:12957:0:(obd_mount.c:710:lustre_put_lsi()) put ffff935b90e92000 1 00000020:00000080:0.0:1787432808.179104:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f72a 00000020:00000080:0.0:1787432808.179117:0:12957:0:(genops.c:885:class_export_put()) final put ffff935b98a92000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787432808.179123:0:12957:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787432808.179129:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787432808.179134:0:12957:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787432808.179139:0:12957:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff935b91a80000) has no exports 00000020:00000080:1.0:1787432808.179545:0:12223:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935b90918000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787432808.179556:0:12223:0:(genops.c:885:class_export_put()) final put ffff935bbd7b3800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787432808.179559:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935bbd7b3800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787432808.179583:0:12223:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787432808.179685:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935b98a92000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787432808.259885:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432808.259904:0:12957:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787432808.259911:0:12957:0:(genops.c:885:class_export_put()) final put ffff935b90e97000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787432808.259917:0:12957:0:(genops.c:844:class_export_destroy()) destroying export ffff935b90e97000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787432808.259931:0:12957:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787432808.260235:0:12957:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff935b90e94000 00000020:01000000:1.0:1787432808.260265:0:12957:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787432808.260271:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432808.260277:0:12957:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787432808.260282:0:12957:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff935b86838000) has no exports 00000100:00100000:1.0:1787432808.260409:0:5868:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff935b879b9000:5868] 1 exiting: rc = 0 00000100:00100000:1.0:1787432808.260551:0:5869:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff935b879b8e00:5869] 2 exiting: rc = 0 00000100:00100000:1.0:1787432808.260629:0:5867:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff935b879b9200:5867] 0 exiting: rc = 1 00000100:00100000:1.0:1787432808.261775:0:6929:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff935b908aca00:6929] 3 exiting: rc = 0 00000100:00100000:2.0:1787432808.262600:0:8110:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff935bbb63ac00:8110] 4 exiting: rc = 0 00000100:00100000:1.0:1787432808.264131:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264145:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264151:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264157:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264162:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264168:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264173:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264180:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264187:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264194:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264213:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264221:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264227:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264233:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264240:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264246:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264252:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264259:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264265:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264271:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264278:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264284:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264289:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264296:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264303:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264326:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264332:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264356:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264363:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264369:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.264376:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.265521:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.265528:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.265535:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.265541:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.265548:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.265557:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.265767:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.265781:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.265786:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.265792:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266140:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266181:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266188:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266194:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266201:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266208:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266214:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266220:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266226:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266232:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266239:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266245:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266252:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266259:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266264:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266270:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266276:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266284:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266290:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266313:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266320:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266326:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.266333:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.276051:0:5870:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff935b87994600:5870] 0 exiting: rc = 1 00000100:00100000:1.0:1787432808.276230:0:5871:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff935b8686c400:5871] 1 exiting: rc = 0 00000100:00100000:1.0:1787432808.276302:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276313:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276320:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276328:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276335:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276458:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276470:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276476:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276484:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276492:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276499:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276505:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276516:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276522:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276528:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276533:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276539:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276545:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276550:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276556:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276561:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276886:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276901:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276910:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276916:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276921:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276927:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276932:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.276943:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277011:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277032:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277037:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277042:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277047:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277052:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277057:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277062:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277068:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277073:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277078:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277084:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277090:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277096:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277102:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277108:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277115:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277122:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277132:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277138:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277144:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277151:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277156:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277163:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277170:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277176:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277182:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277188:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277195:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277201:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277208:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277214:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277220:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277226:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.277232:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.278890:0:5873:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff935b879e3800:5873] 1 exiting: rc = 0 00000100:00100000:0.0:1787432808.279369:0:5872:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff935b879e3a00:5872] 0 exiting: rc = 1 00000100:00100000:1.0:1787432808.279728:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279738:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279744:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279751:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279757:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279764:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279771:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279789:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279798:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279878:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279886:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279892:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279898:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279905:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279912:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279919:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279925:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279932:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279939:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279962:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279969:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279976:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279983:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279990:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.279997:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280003:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280010:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280017:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280024:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280030:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280039:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280065:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280074:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280088:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280095:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280113:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280119:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280126:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280133:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280139:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280150:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280156:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280163:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280185:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280193:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280204:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280211:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280223:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280230:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280240:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280246:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280253:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280262:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280270:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280281:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280306:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280315:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280321:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280328:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280335:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280353:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280360:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280367:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.280498:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.315379:0:5875:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff935b8686ca00:5875] 1 exiting: rc = 0 00000100:00100000:1.0:1787432808.315852:0:5874:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff935b8686ce00:5874] 0 exiting: rc = 1 00000100:00100000:0.0:1787432808.317238:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317253:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317259:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317265:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317275:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317281:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317290:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317298:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317307:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317313:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317322:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317339:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317346:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317351:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317356:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317361:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317366:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317371:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317377:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317403:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317419:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317425:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317438:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317444:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317450:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317455:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317460:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317465:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317471:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317476:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317482:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317486:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317491:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317496:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317503:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317509:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317514:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317519:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317524:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317529:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317535:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317540:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317545:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317843:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317852:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317857:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317862:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317867:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317873:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317878:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317883:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317889:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317895:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317908:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317929:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317935:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317944:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317951:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317960:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317969:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317975:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317984:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317990:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.317996:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.319849:0:5876:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff935b8686cc00:5876] 0 exiting: rc = 1 00000100:00100000:1.0:1787432808.320538:0:5877:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff935b8686da00:5877] 1 exiting: rc = 0 00000100:00100000:0.0:1787432808.321706:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321716:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321723:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321729:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321735:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321741:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321768:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321774:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321782:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321788:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321796:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321802:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321808:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321814:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321819:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321825:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321830:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321836:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321841:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321846:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321853:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321859:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321864:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321870:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321895:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321901:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321908:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321914:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321919:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321925:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321930:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321936:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321941:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321947:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321953:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321959:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321965:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321971:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321977:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321983:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321989:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.321997:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322005:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322774:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322793:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322800:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322806:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322812:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322818:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322823:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322829:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322835:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322841:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322846:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322852:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322858:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322863:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322873:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322880:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322896:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322902:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322914:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322920:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.322926:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.323519:0:5878:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff935b86863c00:5878] 0 exiting: rc = 1 00000100:00100000:0.0:1787432808.323521:0:5879:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff935b86863e00:5879] 1 exiting: rc = 0 00000100:00100000:0.0:1787432808.324143:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324151:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324161:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324167:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324172:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324179:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324185:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324191:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324198:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324203:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324209:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324219:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324226:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324232:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324237:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324243:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324249:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324255:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324262:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324268:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324273:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324278:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324284:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324289:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324295:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324301:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324307:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324313:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324319:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324343:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324348:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324353:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324358:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324363:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324369:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324375:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324381:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324386:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324392:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324398:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324403:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324408:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324414:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324419:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324425:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324441:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324447:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324452:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324457:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324463:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324468:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324473:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324619:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324627:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324632:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324637:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324648:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324654:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324680:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324688:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324694:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324700:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324705:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.324712:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432808.327203:0:5880:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff935b86863600:5880] 0 exiting: rc = 1 00000100:00100000:0.0:1787432808.327228:0:5881:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff935b86864800:5881] 1 exiting: rc = 0 00000100:00100000:0.0:1787432808.328966:0:5882:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff935b907cd600:5882] 2 exiting: rc = 0 00000100:00100000:0.0:1787432808.329196:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329209:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329216:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329222:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329229:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329236:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329243:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329251:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329293:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329302:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329310:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329316:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329323:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329342:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329349:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329357:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329364:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329371:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329377:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329382:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329388:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329395:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329401:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329418:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329426:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329441:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329450:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329456:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329463:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329470:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329477:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329484:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329507:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329527:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329533:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329539:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329546:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329701:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329711:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329719:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329727:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329733:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329739:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329746:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329755:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329762:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329770:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329777:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329785:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329791:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329797:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329804:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329810:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329816:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329823:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329830:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329850:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329858:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329865:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329872:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329879:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329886:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329893:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432808.329899:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787432808.344289:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432808.344366:0:12957:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787432808.344374:0:12957:0:(genops.c:885:class_export_put()) final put ffff935b98a34800/MDS_uuid 00000020:00000080:1.0:1787432808.344388:0:12957:0:(genops.c:844:class_export_destroy()) destroying export ffff935b98a34800/MDS_uuid for MDS 00000020:01000000:1.0:1787432808.344399:0:12957:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787432808.344591:0:12957:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787432808.566951:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432809.589913:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432810.614101:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432810.746418:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787432810.746450:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812820608:0@lo:400:kworker.0 00000400:00000100:1.0:1787432810.746536:0:3331:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258812820608 offset 0 length 224: 4 00000100:00100000:2.0:1787432810.746598:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812820480:0@lo:400:kworker.0 00000400:00000100:2.0:1787432810.746709:0:3333:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258812820480 offset 0 length 224: 4 00000100:00100000:2.0:1787432810.746800:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432810.746814:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812820352:0@lo:400:kworker.0 00000400:00000100:2.0:1787432810.746845:0:3333:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874258812820352 offset 0 length 224: 4 00000020:01000004:3.0:1787432811.390282:0:13107:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787432811.428818:0:13107:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787432811.428868:0:13107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bb5211a00/0xbcb9e331c3f0fa6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa72 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432811.428884:0:13107:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bb5211a00/0xbcb9e331c3f0fa6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fa72 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432811.428892:0:13107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bb5211a00/0xbcb9e331c3f0fa6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0fa72 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432811.428900:0:13107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff935bb5211a00/0xbcb9e331c3f0fa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0fa72 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432811.428928:0:13107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787432811.428934:0:13107:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787432811.428968:0:13107:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787432811.428979:0:13107:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff935a8705ed80 x1874258812820480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432826 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432811.429001:0:13107:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787432811.429056:0:13107:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787432811.429087:0:13107:0:(import.c:65:import_set_state_nolock()) ffff935a84bb7000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787432811.429575:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812820480:0@lo:400:kworker.0 00000100:00100000:1.0:1787432811.431518:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3329:1874258812820736:0@lo:39:umount.0 00000400:00000100:1.0:1787432811.431591:0:3329:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258812820736 offset 0 length 224: 4 00010000:00010000:2.0:1787432811.432409:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432811.432420:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bb5211a00/0xbcb9e331c3f0fa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0fa72 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432811.432432:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bb5211a00 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:2.0:1787432811.432436:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bb5211a00/0xbcb9e331c3f0fa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0fa72 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432811.432447:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bb5211a00/0xbcb9e331c3f0fa6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xbcb9e331c3f0fa72 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787432811.432455:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bb5211a00/0xbcb9e331c3f0fa6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xbcb9e331c3f0fa72 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432811.432461:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787432811.432463:0:5854:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787432811.432467:0:5854:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787432811.432510:0:5854:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bb5211a00/0xbcb9e331c3f0fa6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbcb9e331c3f0fa72 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432811.432517:0:5854:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787432811.432570:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812820864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432811.432620:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787432811.432834:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bb5211a00/0xbcb9e331c3f0fa6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbcb9e331c3f0fa72 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432811.432843:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bb5211a00/0xbcb9e331c3f0fa6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbcb9e331c3f0fa72 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432811.432878:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432811.432879:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432811.432881:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432811.433140:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812820864 00000100:00100000:0.0:1787432811.433156:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812820864 00000100:00100000:0.0:1787432811.433207:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787432811.433215:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b909ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3331:x1874258812820864:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787432811.433222:0:5851:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787432811 with bad export cookie 13599150352702175060 00000100:00100000:1.0:1787432811.456516:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b909ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3331:x1874258812820864:12345-0@lo:103:ldlm_bl.0 Request processed in 23291us (23885us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787432811.456531:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787432811.457067:0:3331:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.115@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787432811.457074:0:3331:0:(import.c:65:import_set_state_nolock()) ffff935b87c66800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787432811.457079:0:3331:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.115@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1787432811.471453:0:3331:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.115@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787432811.471459:0:3331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787432811.471470:0:3331:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff935a8705f100 x1874258812820352/t0(0) o400->MGC192.168.202.115@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787432826 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432811.471514:0:3331:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff935bbaa50000 x1874258812820864/t0(0) o103->MGC192.168.202.115@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787432827 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787432811.471524:0:3331:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787432811.471527:0:3331:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787432811.471529:0:3331:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787432811.471533:0:3331:0:(import.c:65:import_set_state_nolock()) ffff935b87c66800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432811.471538:0:3331:0:(import.c:510:import_select_connection()) MGC192.168.202.115@tcp: connect to NID 0@lo last attempt 203 00000100:00080000:3.0:1787432811.471547:0:3331:0:(import.c:624:import_select_connection()) MGC192.168.202.115@tcp: import ffff935b87c66800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:0.0:1787432811.471625:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3333:1874258812820352:0@lo:400:kworker.0 00000100:00100000:3.0:1787432811.471633:0:3331:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff935bbad11c00 x1874258812820992/t0(0) o250->MGC192.168.202.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787432811.471886:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3331:1874258812820864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787432811.472394:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3329:1874258812820992:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1787432811.472461:0:3329:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874258812820992 offset 0 length 520: 4 00010000:00010000:2.0:1787432811.638107:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787432812.337705:0:6749:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787432812.337715:0:6749:0:(genops.c:885:class_export_put()) final put ffff935b911ee800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787432812.337757:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff935b911ee800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787432812.337810:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935b911ec800 for lustre-OST0000 00000001:00100000:1.0:1787432812.346902:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787432812.346912:0:7682:0:(genops.c:885:class_export_put()) final put ffff935a85a82800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787432812.346983:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935a85a82800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787432812.347031:0:12223:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935a85a81000 for lustre-OST0001 00010000:00010000:0.0:1787432812.661965:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432813.688127:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432814.709806:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432815.733888:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787432815.861803:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2afcd650-d22d-4efa-b57b-1cd88d01ee9e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787432815.861823:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2afcd650-d22d-4efa-b57b-1cd88d01ee9e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787432815.861948:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812821120:0@lo:400:kworker.0 00000400:00000100:2.0:1787432815.862003:0:3332:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258812821120 offset 0 length 224: 4 00010000:00010000:2.0:1787432816.757857:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787432816.886030:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2afcd650-d22d-4efa-b57b-1cd88d01ee9e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787432816.886041:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2afcd650-d22d-4efa-b57b-1cd88d01ee9e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787432816.886150:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787432816.886165:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812821248:0@lo:400:kworker.0 00000400:00000100:2.0:1787432816.886209:0:3332:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258812821248 offset 0 length 224: 4 00010000:00010000:2.0:1787432817.782162:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432818.807682:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432819.835970:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432820.853829:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432821.878317:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787432822.005825:0:12223:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2afcd650-d22d-4efa-b57b-1cd88d01ee9e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787432822.005836:0:12223:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2afcd650-d22d-4efa-b57b-1cd88d01ee9e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787432822.006004:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787432822.006021:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812821376:0@lo:400:kworker.0 00000400:00000100:1.0:1787432822.006124:0:3331:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258812821376 offset 0 length 224: 4 00000100:00100000:3.0:1787432822.006256:0:3329:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432811/real 1787432811] req@ffff935bbad11c00 x1874258812820992/t0(0) o250->MGC192.168.202.115@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787432821 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432822.006282:0:3329:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff935bbad11c00 x1874258812820992/t0(0) o250->MGC192.168.202.115@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787432821 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432822.006317:0:3329:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432811/real 1787432811] req@ffff935bbad13b80 x1874258812820736/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787432821 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432822.006332:0:3329:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff935bbad13b80 x1874258812820736/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787432821 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787432822.006355:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935b87c66800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787432822.006375:0:3329:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1787432822.006379:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3329:1874258812820992:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1787432822.006386:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935a84bb7000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787432822.006399:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3329:1874258812820736:0@lo:39:umount.0 00000100:00080000:1.0:1787432822.006467:0:12223:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2afcd650-d22d-4efa-b57b-1cd88d01ee9e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787432822.006471:0:12223:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787432822.006474:0:12223:0:(import.c:65:import_set_state_nolock()) ffff935b87c66800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787432822.006479:0:12223:0:(import.c:510:import_select_connection()) MGC192.168.202.115@tcp: connect to NID 0@lo last attempt 446 00000100:00080000:1.0:1787432822.006484:0:12223:0:(import.c:589:import_select_connection()) MGC192.168.202.115@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787432822.006490:0:12223:0:(import.c:624:import_select_connection()) MGC192.168.202.115@tcp: import ffff935b87c66800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787432822.006509:0:12223:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff935a8705d500 x1874258812821504/t0(0) o250->MGC192.168.202.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787432822.006615:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3329:1874258812821504:0@lo:250:kworker.0 00000400:00000100:3.0:1787432822.006642:0:3329:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874258812821504 offset 0 length 520: 4 00000100:00080000:0.0:1787432822.007889:0:13107:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787432822.007900:0:13107:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787432822.007909:0:13107:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787432822.008940:0:13107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2166c00/0xbcb9e331c3f0fa79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa80 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432822.008960:0:13107:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2166c00/0xbcb9e331c3f0fa79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fa80 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432822.008968:0:13107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2166c00/0xbcb9e331c3f0fa79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0fa80 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432822.008976:0:13107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff935bc2166c00/0xbcb9e331c3f0fa79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0fa80 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432822.009013:0:13107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787432822.009021:0:13107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f0fcb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fcb7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432822.009045:0:13107:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f0fcb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fcb7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432822.009052:0:13107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f0fcb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0fcb7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432822.009059:0:13107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f0fcb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0fcb7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432822.009218:0:13107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787432822.009225:0:13107:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787432822.009254:0:13107:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787432822.009260:0:13107:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787432822.009266:0:13107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787432822.009273:0:13107:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787432822.009279:0:13107:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff935bbae7b370) has no exports 00000020:00080000:0.0:1787432822.009317:0:13107:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff935bbae7b370) has no exports 00000020:01000000:0.0:1787432822.011201:0:13107:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff935bb9caed80 - data ffff935b9f6795e8/ffff935a8654fc00 00010000:00010000:3.0:1787432822.016713:0:11210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787432822.016742:0:11210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bc2166c00/0xbcb9e331c3f0fa79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0fa80 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432822.016762:0:11210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2166c00 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:3.0:1787432822.016767:0:11210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bc2166c00/0xbcb9e331c3f0fa79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0fa80 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432822.016781:0:11210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bc2166c00/0xbcb9e331c3f0fa79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xbcb9e331c3f0fa80 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432822.016788:0:11210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bc2166c00/0xbcb9e331c3f0fa79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xbcb9e331c3f0fa80 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432822.016823:0:11210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787432822.016826:0:11210:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1787432822.016831:0:11210:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1787432822.016855:0:11210:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff935b87c66800 00010000:00010000:3.0:1787432822.016860:0:11210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bc2166c00/0xbcb9e331c3f0fa79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xbcb9e331c3f0fa80 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432822.016867:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bc2166c00/0xbcb9e331c3f0fa79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xbcb9e331c3f0fa80 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432822.016885:0:11210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432822.016889:0:11210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f0fcb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0fcb7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432822.016896:0:11210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e7a00 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:3.0:1787432822.016899:0:11210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f0fcb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0fcb7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432822.016906:0:11210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f0fcb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbcb9e331c3f0fcb7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432822.016912:0:11210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f0fcb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbcb9e331c3f0fcb7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432822.016917:0:11210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787432822.016920:0:11210:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787432822.016922:0:11210:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787432822.016929:0:11210:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff935b87c66800 00010000:00010000:3.0:1787432822.016932:0:11210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f0fcb0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbcb9e331c3f0fcb7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432822.016950:0:11210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f0fcb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbcb9e331c3f0fcb7 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432822.016960:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432822.016967:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432822.016970:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432822.017335:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787432822.017566:0:13107:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff935b91a61000 - data ffff935b9f6ec000/ffff935a850bb000 00100000:10000000:0.0:1787432822.031089:0:13107:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787432822.111625:0:13107:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f888 00000020:00000080:2.0:1787432822.111637:0:13107:0:(genops.c:885:class_export_put()) final put ffff935bbaf23800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787432822.111767:0:13107:0:(tgt_mount.c:187:server_put_mount()) put mount ffff935bbb3e4800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787432822.111772:0:13107:0:(obd_mount.c:710:lustre_put_lsi()) put ffff935bbb3e4800 2 00000020:01000004:2.0:1787432822.111775:0:13107:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff935bbb3e4800 from lustre-OST0000 00000020:00000080:2.0:1787432822.111860:0:13107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787432822.111874:0:13107:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787432822.111878:0:13107:0:(genops.c:885:class_export_put()) final put ffff935b9091e800/lustre-OST0000_UUID 00000020:00000080:2.0:1787432822.111882:0:13107:0:(genops.c:844:class_export_destroy()) destroying export ffff935b9091e800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787432822.111904:0:13107:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787432822.111956:0:13107:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787432822.111961:0:13107:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787432822.111966:0:13107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787432822.111972:0:13107:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787432822.111979:0:13107:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff935b87dea800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787432822.111984:0:13107:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff935b9078b370) has exports, disconnecting them 00000020:00080000:2.0:1787432822.111990:0:13107:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff935b87dea800), last request at 1787432586 00000020:00000080:2.0:1787432822.111994:0:13107:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f8b2 00000020:00080000:2.0:1787432822.112005:0:13107:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff935b87dea800): rc 0 00000020:00000080:2.0:1787432822.112011:0:13107:0:(genops.c:885:class_export_put()) final put ffff935b87dea800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787432822.114116:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935bbaf23800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787432822.118741:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935b87dea800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787432822.190583:0:13107:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787432822.190592:0:13107:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787432822.190597:0:13107:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787432822.190605:0:13107:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787432822.190683:0:12223:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935a84bb7000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787432822.191018:0:13107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432822.191028:0:13107:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787432822.191034:0:13107:0:(genops.c:885:class_export_put()) final put ffff935a84bb5000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787432822.191038:0:13107:0:(genops.c:844:class_export_destroy()) destroying export ffff935a84bb5000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787432822.191050:0:13107:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1787432822.191134:0:13107:0:(obd_mount.c:710:lustre_put_lsi()) put ffff935bbb3e4800 1 00000020:00000080:1.0:1787432822.191140:0:13107:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f842 00000020:00000080:1.0:1787432822.191147:0:13107:0:(genops.c:885:class_export_put()) final put ffff935b90898800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787432822.191156:0:13107:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787432822.191161:0:13107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432822.191166:0:13107:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787432822.191171:0:13107:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff935b9078cd28) has no exports 00000020:00000080:3.0:1787432822.191549:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935b90898800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787432822.220481:0:13107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787432822.220496:0:13107:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787432822.220502:0:13107:0:(genops.c:885:class_export_put()) final put ffff935ba6bcc800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787432822.220506:0:13107:0:(genops.c:844:class_export_destroy()) destroying export ffff935ba6bcc800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787432822.220513:0:13107:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787432822.220632:0:13107:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff935ba6bcd800 00000020:02000400:2.0:1787432822.220740:0:13107:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787432822.909695:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432823.926265:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432824.949867:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787432825.174459:0:13262:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787432825.205870:0:13262:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787432825.205953:0:13262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba416800/0xbcb9e331c3f0fa4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa56 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432825.205969:0:13262:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba416800/0xbcb9e331c3f0fa4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fa56 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432825.205993:0:13262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba416800/0xbcb9e331c3f0fa4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0fa56 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432825.206000:0:13262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff935bba416800/0xbcb9e331c3f0fa4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0fa56 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432825.206020:0:13262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787432825.206025:0:13262:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787432825.206045:0:13262:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787432825.206056:0:13262:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff935a8705d880 x1874258812820608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432826 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432825.206077:0:13262:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff935bbad28e00 x1874258812821120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432831 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432825.206099:0:13262:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff935bbad10380 x1874258812821248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432832 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432825.206108:0:13262:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff935bbad11180 x1874258812821376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432838 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432825.206116:0:13262:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787432825.206121:0:13262:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787432825.206149:0:13262:0:(import.c:65:import_set_state_nolock()) ffff935a85a83000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787432825.206227:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812821248:0@lo:400:kworker.0 00000100:00100000:3.0:1787432825.206236:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812821120:0@lo:400:kworker.0 00000100:00100000:3.0:1787432825.206283:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3329:1874258812821632:0@lo:39:umount.0 00000400:00000100:3.0:1787432825.206347:0:3329:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874258812821632 offset 0 length 224: 4 00010000:00010000:0.0:1787432825.208368:0:5855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432825.208383:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bba416800/0xbcb9e331c3f0fa4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0fa56 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432825.208395:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba416800 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:0.0:1787432825.208400:0:5855:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bba416800/0xbcb9e331c3f0fa4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0fa56 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432825.208433:0:5855:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bba416800/0xbcb9e331c3f0fa4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbcb9e331c3f0fa56 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432825.208442:0:5855:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bba416800/0xbcb9e331c3f0fa4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbcb9e331c3f0fa56 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432825.208448:0:5855:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787432825.208451:0:5855:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787432825.208455:0:5855:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787432825.208472:0:5855:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff935b87c66800 00010000:00010000:0.0:1787432825.208476:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bba416800/0xbcb9e331c3f0fa4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbcb9e331c3f0fa56 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432825.208493:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bba416800/0xbcb9e331c3f0fa4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbcb9e331c3f0fa56 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432825.208510:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432825.208512:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432825.208514:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432825.208725:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812821376:0@lo:400:kworker.0 00000100:00100000:1.0:1787432825.208736:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812820608:0@lo:400:kworker.0 00010000:00010000:3.0:1787432825.974688:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432826.997881:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787432827.126006:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2afcd650-d22d-4efa-b57b-1cd88d01ee9e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787432827.126017:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2afcd650-d22d-4efa-b57b-1cd88d01ee9e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787432828.022371:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432829.047204:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432830.069842:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432831.095383:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432832.119186:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787432832.247884:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2afcd650-d22d-4efa-b57b-1cd88d01ee9e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787432832.247900:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2afcd650-d22d-4efa-b57b-1cd88d01ee9e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787432833.146834:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432834.166023:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432835.189930:0:11210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432835.445855:0:3329:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432825/real 1787432825] req@ffff935bbaa50000 x1874258812821632/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787432835 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432835.445904:0:3329:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff935bbaa50000 x1874258812821632/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787432835 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787432835.445955:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935a85a83000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787432835.445980:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3329:1874258812821632:0@lo:39:umount.0 00000100:00080000:2.0:1787432835.446122:0:13262:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787432835.446128:0:13262:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787432835.446135:0:13262:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787432835.450487:0:13262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba417000/0xbcb9e331c3f0fa5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fa64 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432835.450544:0:13262:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba417000/0xbcb9e331c3f0fa5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fa64 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432835.450552:0:13262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba417000/0xbcb9e331c3f0fa5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0fa64 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432835.450559:0:13262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff935bba417000/0xbcb9e331c3f0fa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0fa64 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432835.450604:0:13262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432835.450613:0:13262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0fca2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f0fca9 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432835.450621:0:13262:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0fca2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f0fca9 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432835.450628:0:13262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0fca2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0fca9 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432835.450634:0:13262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0fca2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbcb9e331c3f0fca9 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432835.450654:0:13262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787432835.450680:0:13262:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787432835.450716:0:13262:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787432835.450720:0:13262:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787432835.450726:0:13262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787432835.450733:0:13262:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787432835.450738:0:13262:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff935bbae799b8) has no exports 00000020:00080000:2.0:1787432835.450776:0:13262:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff935bbae799b8) has no exports 00010000:00010000:1.0:1787432835.451412:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432835.451424:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bba417000/0xbcb9e331c3f0fa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0fa64 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432835.451434:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba417000 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:1.0:1787432835.451439:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bba417000/0xbcb9e331c3f0fa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0fa64 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432835.451451:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bba417000/0xbcb9e331c3f0fa5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbcb9e331c3f0fa64 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432835.451475:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bba417000/0xbcb9e331c3f0fa5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbcb9e331c3f0fa64 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432835.451482:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787432835.451484:0:5854:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787432835.451487:0:5854:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787432835.451511:0:5854:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff935b87c66800 00010000:00010000:1.0:1787432835.451517:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bba417000/0xbcb9e331c3f0fa5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbcb9e331c3f0fa64 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432835.451525:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bba417000/0xbcb9e331c3f0fa5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbcb9e331c3f0fa64 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432835.451544:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432835.451548:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0fca2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0fca9 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432835.451554:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031a00 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:1.0:1787432835.451557:0:5854:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0fca2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbcb9e331c3f0fca9 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432835.451565:0:5854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0fca2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbcb9e331c3f0fca9 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432835.451570:0:5854:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0fca2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbcb9e331c3f0fca9 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432835.451575:0:5854:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787432835.451577:0:5854:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787432835.451586:0:5854:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787432835.451603:0:5854:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff935b87c66800 00010000:00010000:1.0:1787432835.451606:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0fca2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbcb9e331c3f0fca9 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432835.451613:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935b80031a00/0xbcb9e331c3f0fca2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbcb9e331c3f0fca9 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432835.451630:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432835.451631:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432835.451634:0:5854:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432835.451805:0:5855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787432835.466214:0:13262:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff935bb9caeb40 - data ffff935b9f64c870/ffff935b90703800 00000020:01000000:2.0:1787432835.466428:0:13262:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff935b913945a0 - data ffff935b9f6db6c0/ffff935a870df800 00100000:10000000:2.0:1787432835.482300:0:13262:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787432835.526899:0:13262:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f953 00000020:00000080:1.0:1787432835.526913:0:13262:0:(genops.c:885:class_export_put()) final put ffff935bbb47d800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787432835.526969:0:13262:0:(tgt_mount.c:187:server_put_mount()) put mount ffff935bbb06d800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787432835.526974:0:13262:0:(obd_mount.c:710:lustre_put_lsi()) put ffff935bbb06d800 2 00000020:01000004:1.0:1787432835.526979:0:13262:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff935bbb06d800 from lustre-OST0001 00000020:00000080:1.0:1787432835.527022:0:13262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432835.527037:0:13262:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787432835.527040:0:13262:0:(genops.c:885:class_export_put()) final put ffff935bbb47e000/lustre-OST0001_UUID 00000020:00000080:1.0:1787432835.527044:0:13262:0:(genops.c:844:class_export_destroy()) destroying export ffff935bbb47e000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787432835.527057:0:13262:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:3.0:1787432835.530600:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935bbb47d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:1.0:1787432835.531598:0:13262:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 2afcd650-d22d-4efa-b57b-1cd88d01ee9e->MGS 00010000:00010000:1.0:1787432835.531619:0:13262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bc2167e00/0xbcb9e331c3f0f865 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbcb9e331c3f0f86c expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432835.531635:0:13262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bc2167e00/0xbcb9e331c3f0f865 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbcb9e331c3f0f86c expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432835.531642:0:13262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787432835.531646:0:13262:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787432835.531650:0:13262:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787432835.531686:0:13262:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff935b87c66800 00010000:00010000:1.0:1787432835.531705:0:13262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bc2167e00/0xbcb9e331c3f0f865 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbcb9e331c3f0f86c expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432835.531726:0:13262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bc2166200/0xbcb9e331c3f0faa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbcb9e331c3f0faaa expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432835.531734:0:13262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bc2166200/0xbcb9e331c3f0faa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbcb9e331c3f0faaa expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432835.531739:0:13262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787432835.531742:0:13262:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787432835.531743:0:13262:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787432835.531751:0:13262:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff935b87c66800 00010000:00010000:1.0:1787432835.531754:0:13262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bc2166200/0xbcb9e331c3f0faa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbcb9e331c3f0faaa expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787432835.531769:0:13262:0:(import.c:65:import_set_state_nolock()) ffff935b87c66800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787432835.531773:0:13262:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787432835.531775:0:13262:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787432835.531777:0:13262:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787432835.531781:0:13262:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787432835.531791:0:13262:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff935a8705d500 x1874258812821504/t0(0) o250->MGC192.168.202.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787432837 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787432835.531810:0:13262:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787432835.531813:0:13262:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:0.0:1787432835.531907:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2afcd650-d22d-4efa-b57b-1cd88d01ee9e:3329:1874258812821504:0@lo:250:kworker.0 10000000:01000000:1.0:1787432835.533288:0:13262:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787432835.533305:0:13262:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f746 00000020:00000080:1.0:1787432835.533314:0:13262:0:(genops.c:885:class_export_put()) final put ffff935b98a33800/2afcd650-d22d-4efa-b57b-1cd88d01ee9e 00000020:01000000:1.0:1787432835.533338:0:13262:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.115@tcp (flags='') 00000020:00000080:1.0:1787432835.533347:0:13262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432835.533355:0:13262:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.115@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787432835.533359:0:13262:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff935b879b0000) has no exports 00000020:00000080:3.0:1787432835.533418:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935b98a33800/2afcd650-d22d-4efa-b57b-1cd88d01ee9e for MGC192.168.202.115@tcp 10000000:01000000:0.0:1787432835.533543:0:5864:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787432835.533804:0:13262:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.115@tcp: client import never connected 00000100:00080000:1.0:1787432835.533810:0:13262:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787432835.533814:0:13262:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787432835.533817:0:13262:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787432835.533820:0:13262:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787432835.533881:0:13262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787432835.533890:0:13262:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.115@tcp (uuid 2afcd650-d22d-4efa-b57b-1cd88d01ee9e) 00000020:01000000:1.0:1787432835.533897:0:13262:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787432835.533903:0:13262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787432835.533909:0:13262:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787432835.533916:0:13262:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff935a85a80800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787432835.533922:0:13262:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff935bbae78000) has exports, disconnecting them 00000020:00080000:1.0:1787432835.533927:0:13262:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff935a85a80800), last request at 1787432607 00000020:00000080:1.0:1787432835.533932:0:13262:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f97d 00000020:00080000:1.0:1787432835.533948:0:13262:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff935a85a80800): rc 0 00000020:00000080:1.0:1787432835.533953:0:13262:0:(genops.c:885:class_export_put()) final put ffff935a85a80800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787432835.534394:0:12223:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935b87c66800 for MGC192.168.202.115@tcp 00000020:00000080:3.0:1787432835.534403:0:12223:0:(genops.c:885:class_export_put()) final put ffff935b87c65800/2afcd650-d22d-4efa-b57b-1cd88d01ee9e 00000020:00000080:3.0:1787432835.534405:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935b87c65800/2afcd650-d22d-4efa-b57b-1cd88d01ee9e for MGC192.168.202.115@tcp 00000020:01000000:3.0:1787432835.534412:0:12223:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.115@tcp (2afcd650-d22d-4efa-b57b-1cd88d01ee9e) 00000020:00000080:3.0:1787432835.534740:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935a85a80800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787432835.613824:0:13262:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787432835.613839:0:13262:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787432835.613845:0:13262:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787432835.613857:0:13262:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787432835.613966:0:11210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1787432835.614192:0:12223:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff935a85a83000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1787432835.616605:0:5854:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787432835.617735:0:5855:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1787432835.617883:0:5850:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff935b98b9d200:5850] 1 exiting: rc = 0 00000100:00100000:3.0:1787432835.618040:0:5849:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff935b98b9c600:5849] 0 exiting: rc = 1 00000100:00100000:0.0:1787432835.618257:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432835.620255:0:5851:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff935b87496800:5851] 0 exiting: rc = 1 00000100:00100000:3.0:1787432835.621800:0:8489:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff935a85043000:8489] 3 exiting: rc = 0 00000100:00100000:2.0:1787432835.623022:0:5853:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff935b87496200:5853] 2 exiting: rc = 0 00000100:00100000:2.0:1787432835.623146:0:5852:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff935b87496e00:5852] 1 exiting: rc = 0 00000100:00100000:3.0:1787432835.623363:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623374:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623382:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623390:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623397:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623403:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623410:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623416:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623422:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623438:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623445:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623452:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623459:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623466:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623472:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623479:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623501:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623508:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623514:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623519:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623525:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623530:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623535:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623540:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623544:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623550:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623555:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623560:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623565:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623570:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623575:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623580:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623585:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623590:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623596:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623602:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623609:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623614:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623619:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623624:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623629:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623634:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623644:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623649:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623682:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623690:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623697:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623704:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623709:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623716:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623722:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623735:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623740:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623745:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623751:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623756:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623761:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623767:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623773:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623778:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623784:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623790:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623796:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.623802:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787432835.627972:0:13262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787432835.627989:0:13262:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787432835.627996:0:13262:0:(genops.c:885:class_export_put()) final put ffff935bbb479800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787432835.628003:0:13262:0:(genops.c:844:class_export_destroy()) destroying export ffff935bbb479800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787432835.628010:0:13262:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1787432835.628067:0:13262:0:(obd_mount.c:710:lustre_put_lsi()) put ffff935bbb06d800 1 00000020:00000080:3.0:1787432835.628074:0:13262:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f0f922 00000020:00000080:3.0:1787432835.628082:0:13262:0:(genops.c:885:class_export_put()) final put ffff935bbb068800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787432835.628098:0:13262:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787432835.628105:0:13262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787432835.628110:0:13262:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787432835.628115:0:13262:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff935b8683b370) has no exports 00000020:00000080:0.0:1787432835.628486:0:12223:0:(genops.c:844:class_export_destroy()) destroying export ffff935bbb068800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787432835.681326:0:13262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787432835.681352:0:13262:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787432835.681359:0:13262:0:(genops.c:885:class_export_put()) final put ffff935bbb069000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787432835.681365:0:13262:0:(genops.c:844:class_export_destroy()) destroying export ffff935bbb069000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787432835.681378:0:13262:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787432835.682506:0:13262:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff935bbb068000 00000020:01000000:3.0:1787432835.682542:0:13262:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787432835.682547:0:13262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787432835.682566:0:13262:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787432835.682572:0:13262:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff935b90628000) has no exports 00000020:00000080:3.0:1787432835.682600:0:13262:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787432835.682610:0:13262:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787432835.682614:0:13262:0:(genops.c:885:class_export_put()) final put ffff935b90899000/OSS_uuid 00000020:00000080:3.0:1787432835.682617:0:13262:0:(genops.c:844:class_export_destroy()) destroying export ffff935b90899000/OSS_uuid for OSS 00000020:01000000:3.0:1787432835.682622:0:13262:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1787432835.682757:0:5863:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787432835.683385:0:6726:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff935b90e7f000:6726] 2 exiting: rc = 0 00000100:00100000:1.0:1787432835.684680:0:6725:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff935bbb3d0a00:6725] 1 exiting: rc = 0 00000100:00100000:2.0:1787432835.686534:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff935a84914800:8446] 3 exiting: rc = 0 00000100:00100000:2.0:1787432835.686654:0:6724:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff935bbb3d0c00:6724] 0 exiting: rc = 1 00000100:00100000:2.0:1787432835.686730:0:12109:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff935a84914400:12109] 4 exiting: rc = 0 00000100:00100000:3.0:1787432835.686938:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.686948:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.686956:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.686964:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.686970:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.686976:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.686982:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.686988:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687192:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687202:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687208:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687213:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687219:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687225:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687231:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687238:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687245:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687251:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687257:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687262:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687268:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687275:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687280:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687286:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687292:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687298:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687322:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687328:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687334:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687340:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687346:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687352:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687358:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687365:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687371:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687376:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687383:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687389:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687395:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687401:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687407:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687414:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687421:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687604:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687614:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687620:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687626:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687631:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687638:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687855:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687868:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687874:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687879:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687885:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687892:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687898:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687904:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687911:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687918:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687923:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687929:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687945:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687951:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.687956:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.695726:0:6728:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff935bb7c44200:6728] 1 exiting: rc = 0 00000100:00100000:2.0:1787432835.700673:0:6727:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff935b9a498800:6727] 0 exiting: rc = 1 00000100:00100000:0.0:1787432835.730016:0:9985:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff935bbabd5e00:9985] 2 exiting: rc = 0 00000100:00100000:3.0:1787432835.730772:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730785:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730791:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730798:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730805:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730811:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730817:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730823:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730830:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730836:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730842:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730847:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730853:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730858:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730863:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730869:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730875:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730881:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730887:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730893:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730901:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730907:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730913:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730920:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730925:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730931:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730937:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730943:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730949:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730954:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730960:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.730989:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731008:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731015:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731020:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731026:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731033:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731039:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731046:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731051:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731057:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731063:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731069:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731074:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731079:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731085:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731355:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731366:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731372:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731378:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731384:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731391:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731404:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731411:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731418:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731426:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731444:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731449:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731455:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731463:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731468:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731474:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731480:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.731486:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432835.739385:0:6730:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff935bb7c45200:6730] 1 exiting: rc = 0 00000100:00100000:1.0:1787432835.739969:0:6729:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff935b98ab7e00:6729] 0 exiting: rc = 1 00000100:00100000:0.0:1787432835.739982:0:6731:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff935b90e6f400:6731] 2 exiting: rc = 0 00000100:00100000:3.0:1787432835.791753:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.791769:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793412:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793435:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793443:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793478:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793486:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793492:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793499:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793505:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793511:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793518:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793526:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793532:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793538:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793550:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793556:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793563:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793569:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793574:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793580:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793586:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793594:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793600:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793606:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793612:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793618:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793625:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.793632:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794271:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794287:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794294:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794301:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794307:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794313:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794319:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794326:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794351:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794358:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794365:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794371:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794377:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794383:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794390:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794396:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794403:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794410:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794418:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794724:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794735:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794742:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794750:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794757:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794764:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794775:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794782:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794814:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794825:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794833:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794844:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794851:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794859:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794865:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.794872:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787432835.822782:0:6732:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff935b87810200:6732] 0 exiting: rc = 1 00000100:00100000:0.0:1787432835.822959:0:6733:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff935b87811800:6733] 1 exiting: rc = 0 00000100:00100000:3.0:1787432835.826396:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.826410:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.826416:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.826424:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827139:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827147:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827154:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827159:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827197:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827203:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827209:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827215:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827287:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827295:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827302:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827308:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827314:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827321:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827328:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827334:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827339:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827344:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827350:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827355:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827361:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827366:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827372:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827377:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827382:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827388:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827394:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827399:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827404:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827409:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827415:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.827425:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828676:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828685:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828691:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828697:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828702:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828708:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828713:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828739:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828745:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828755:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828761:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828766:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828773:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828778:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828783:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828787:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828792:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828797:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828803:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828809:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828818:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828825:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828830:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828835:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828839:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828844:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828849:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.828854:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787432835.837723:0:6734:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff935b90e6e600:6734] 0 exiting: rc = 1 00000100:00100000:1.0:1787432835.837965:0:6735:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff935b90e6e000:6735] 1 exiting: rc = 0 00000100:00100000:3.0:1787432835.839461:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839498:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839506:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839512:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839520:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839526:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839532:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839539:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839547:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839554:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839561:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839569:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839576:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839599:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839625:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839635:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839644:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839651:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839675:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839682:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839689:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839696:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839702:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839709:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839716:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839742:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839751:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839758:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839764:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839770:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839776:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839782:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839789:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839797:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839805:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839812:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839820:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839843:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839852:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839859:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839865:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839872:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839878:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839884:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839890:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839896:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839903:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839909:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839916:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839946:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839955:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839961:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839967:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839973:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839979:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839988:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.839997:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.840004:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.840013:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.840021:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.840027:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.840050:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.840059:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787432835.840066:0:13262:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1787432835.878324:0:13262:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787432855.112464:0:13877:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787432865.758839:0:14337:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787432865.758844:0:14337:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787432865.759210:0:14337:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff935bbb47d000 00000020:01000004:2.0:1787432865.759229:0:14337:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787432865.759237:0:14337:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787432865.759393:0:14337:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff935bbae7b370) 00000020:00000080:2.0:1787432865.759408:0:14337:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787432865.789084:0:14337:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787432865.801800:0:14337:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787432865.802838:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 235: rc = 0 00100000:10000000:3.0:1787432865.806951:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 235: rc = 0 00100000:10000000:3.0:1787432865.807380:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 235: rc = 0 00100000:10000000:3.0:1787432865.807484:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 235: rc = 0 00100000:10000000:3.0:1787432865.807576:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 235: rc = 0 00100000:10000000:3.0:1787432865.809482:0:14337:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787432865.809577:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 235: rc = 0 00100000:10000000:3.0:1787432865.812582:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 237: rc = 0 00100000:10000000:2.0:1787432865.816626:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 552: rc = 0 00100000:10000000:2.0:1787432865.817581:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 552: rc = 0 00100000:10000000:2.0:1787432865.821724:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 304: rc = 0 00100000:10000000:2.0:1787432865.823813:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 304: rc = 0 00100000:10000000:2.0:1787432865.825428:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 304: rc = 0 00100000:10000000:2.0:1787432865.830772:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 304: rc = 0 00100000:10000000:2.0:1787432865.831597:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 304: rc = 0 00100000:10000000:2.0:1787432865.836634:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 304: rc = 0 00100000:10000000:2.0:1787432865.842720:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 304: rc = 0 00100000:10000000:2.0:1787432865.844713:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 304: rc = 0 00100000:10000000:2.0:1787432865.845051:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 304: rc = 0 00100000:10000000:2.0:1787432865.847697:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 304: rc = 0 00100000:10000000:2.0:1787432865.848019:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 304: rc = 0 00100000:10000000:3.0:1787432865.860777:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 304: rc = 0 00100000:10000000:3.0:1787432865.861502:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 418: rc = 0 00100000:10000000:3.0:1787432865.861801:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 418: rc = 0 00100000:10000000:3.0:1787432865.862048:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 418: rc = 0 00100000:10000000:3.0:1787432865.862713:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 418: rc = 0 00100000:10000000:3.0:1787432865.863570:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 418: rc = 0 00100000:10000000:3.0:1787432865.864454:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 418: rc = 0 00100000:10000000:3.0:1787432865.864750:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 418: rc = 0 00100000:10000000:3.0:1787432865.866998:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 418: rc = 0 00100000:10000000:3.0:1787432865.867531:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 418: rc = 0 00100000:10000000:3.0:1787432865.867983:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 418: rc = 0 00100000:10000000:3.0:1787432865.868384:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 418: rc = 0 00100000:10000000:3.0:1787432865.868638:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 418: rc = 0 00100000:10000000:3.0:1787432865.869341:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 418: rc = 0 00100000:10000000:3.0:1787432865.869627:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 418: rc = 0 00100000:10000000:3.0:1787432865.870453:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 418: rc = 0 00100000:10000000:3.0:1787432865.871314:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 418: rc = 0 00100000:10000000:3.0:1787432865.871587:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 418: rc = 0 00100000:10000000:3.0:1787432865.872494:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 418: rc = 0 00100000:10000000:3.0:1787432865.872787:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 418: rc = 0 00100000:10000000:3.0:1787432865.873338:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 418: rc = 0 00100000:10000000:3.0:1787432865.873597:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 418: rc = 0 00100000:10000000:3.0:1787432865.875266:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 418: rc = 0 00100000:10000000:3.0:1787432865.875553:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 418: rc = 0 00100000:10000000:3.0:1787432865.875821:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 418: rc = 0 00100000:10000000:3.0:1787432865.876091:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 418: rc = 0 00100000:10000000:3.0:1787432865.878482:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 418: rc = 0 00100000:10000000:3.0:1787432865.880393:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 418: rc = 0 00100000:10000000:3.0:1787432865.880709:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 418: rc = 0 00100000:10000000:3.0:1787432865.881011:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 418: rc = 0 00100000:10000000:2.0:1787432865.884966:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 418: rc = 0 00100000:10000000:2.0:1787432865.885416:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 418: rc = 0 00100000:10000000:2.0:1787432865.885747:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 418: rc = 0 00100000:10000000:2.0:1787432865.886548:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 407: rc = 0 00100000:10000000:2.0:1787432865.890790:0:14337:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787432865.892485:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 556: rc = 0 00100000:10000000:2.0:1787432865.892709:0:14337:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787432865.892785:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 556: rc = 0 00100000:10000000:2.0:1787432865.894499:0:14337:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787432865.894571:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 556: rc = 0 00100000:10000000:2.0:1787432865.895453:0:14337:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787432865.895527:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 553: rc = 0 00100000:10000000:2.0:1787432865.896001:0:14337:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787432865.896062:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 553: rc = 0 00100000:10000000:2.0:1787432865.896458:0:14337:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787432865.896529:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 553: rc = 0 00000020:00000080:2.0:1787432865.897095:0:14337:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787432865.900319:0:14337:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787432865.900346:0:14337:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbcb9e331c3f10a47 00000020:01000004:2.0:1787432865.900357:0:14337:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787432865.900365:0:14337:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787432865.900373:0:14337:0:(tgt_mount.c:101:server_register_mount()) register mount ffff935bbb47d000 from MGS 00000020:01000004:2.0:1787432865.900378:0:14337:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787432865.900393:0:14337:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff935bbae7cd28) 00000020:00000080:2.0:1787432865.900405:0:14337:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787432865.900472:0:14337:0:(tgt_mount.c:153:server_get_mount()) get mount ffff935bbb47d000 from MGS, refs=2 00080000:01000000:2.0:1787432865.900486:0:14337:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787432865.900491:0:14337:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbcb9e331c3f10a55 00000100:00100000:2.0:1787432865.900607:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787432865.900772:0:14337:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787432865.900778:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787432865.903358:0:14337:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787432865.903368:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787432865.904459:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787432865.904637:0:14337:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787432865.904643:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787432865.905712:0:14337:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787432865.905720:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787432865.912556:0:14337:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787432865.912579:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787432865.917081:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432865.917087:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432865.917090:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432865.917494:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432865.917497:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432865.917500:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432865.918842:0:14337:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787432865.925834:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787432865.949336:0:14337:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787432865.949356:0:14337:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787432865.949358:0:14337:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787432865.963810:0:14346:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787432865.964434:0:14337:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787432865.964578:0:14337:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787432865.965591:0:14337:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787432865.968608:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787432865.968808:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787432865.968814:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787432865.972467:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787432865.972491:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787432865.976367:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787432865.976383:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787432865.995437:0:14337:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787432865.995462:0:14337:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.115@tcp' 00000020:01000004:0.0:1787432865.995464:0:14337:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787432865.995526:0:14337:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.115@tcp (typ=mgc) 00000020:00000080:0.0:1787432865.995541:0:14337:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.115@tcp (ffff935b91a83370) 00000020:00000080:0.0:1787432865.995559:0:14337:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787432865.995641:0:14337:0:(ldlm_lib.c:102:import_set_conn()) imp ffff935bbaa06800@MGC192.168.202.115@tcp: add connection 192.168.202.115@tcp at head 00000100:00080000:2.0:1787432865.996338:0:14351:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:0.0:1787432865.996567:0:14337:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.115@tcp-0 is initialized 00000040:01000000:0.0:1787432865.996575:0:14337:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787432866.004527:0:14353:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787432866.004753:0:14337:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.115@tcp (uuid 1d00b432-f54a-428d-8e42-8523236fbac8) 00000020:00000080:1.0:1787432866.004780:0:14337:0:(genops.c:1385:class_connect()) connect: client 1d00b432-f54a-428d-8e42-8523236fbac8, cookie 0xbcb9e331c3f10a63 00000100:00080000:1.0:1787432866.004793:0:14337:0:(import.c:510:import_select_connection()) MGC192.168.202.115@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787432866.004799:0:14337:0:(import.c:624:import_select_connection()) MGC192.168.202.115@tcp: import ffff935bbaa06800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787432866.005209:0:14337:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff935a8705d880 x1874258812821760/t0(0) o250->MGC192.168.202.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787432866.005243:0:14337:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 1d00b432-f54a-428d-8e42-8523236fbac8->MGS 00000020:01000004:1.0:1787432866.005273:0:14337:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787432866.005278:0:14337:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787432866.005293:0:14337:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff935b9078b370) 00000020:00000080:1.0:1787432866.005305:0:14337:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787432866.005637:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1d00b432-f54a-428d-8e42-8523236fbac8:3329:1874258812821760:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787432866.005739:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432866.008172:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812821760 00000100:00100000:2.0:1787432866.008186:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812821760 00000100:00100000:2.0:1787432866.008230:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787432866.008238:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b95016c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3329:x1874258812821760:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787432866.008269:0:14347:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1d00b432-f54a-428d-8e42-8523236fbac8@0@lo t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:2.0:1787432866.008302:0:14347:0:(genops.c:1385:class_connect()) connect: client 1d00b432-f54a-428d-8e42-8523236fbac8, cookie 0xbcb9e331c3f10a71 00000100:00080000:2.0:1787432866.008453:0:14347:0:(import.c:65:import_set_state_nolock()) ffff935a84b91800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432866.008543:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b95016c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+5:3329:x1874258812821760:12345-0@lo:250:mount.lustre.0 Request processed in 304us (2804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432866.008553:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787432866.008619:0:3329:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.115@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787432866.008636:0:3329:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.115@tcp: connect to target with instance 0 00000100:00080000:2.0:1787432866.008644:0:3329:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.115@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787432866.008649:0:3329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787432866.008652:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935bbaa06800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787432866.008654:0:3329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787432866.008678:0:3329:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787432866.008683:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1d00b432-f54a-428d-8e42-8523236fbac8:3329:1874258812821760:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787432866.062787:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432866.063029:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787432866.063043:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787432866.065755:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787432866.065769:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787432866.068990:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787432866.069005:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787432866.071706:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432866.075485:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787432866.075496:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787432866.084383:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787432866.084395:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787432866.155388:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432866.155613:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787432866.155620:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787432866.159328:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787432866.159349:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787432866.161199:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787432866.161415:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787432866.161422:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787432866.162642:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787432866.162653:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787432866.163619:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432866.172608:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787432866.172624:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787432866.173542:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787432866.173551:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787432866.175762:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432866.176263:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787432866.176271:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787432866.178265:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787432866.178278:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787432866.222427:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787432866.222642:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787432866.222647:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787432866.232362:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787432866.232390:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787432866.234384:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787432866.234402:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787432866.240744:0:14337:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787432866.240773:0:14337:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787432866.240780:0:14337:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.115@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787432866.240945:0:14337:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787432866.240991:0:14337:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.115@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787432866.240996:0:14337:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787432866.240997:0:14337:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787432866.240999:0:14337:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432866.241000:0:14337:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432866.241001:0:14337:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432866.241003:0:14337:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432866.241004:0:14337:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787432866.241006:0:14337:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787432866.241008:0:14337:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432866.241013:0:14337:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787432866.241016:0:14337:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787432866.241018:0:14337:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787432866.241019:0:14337:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787432866.241020:0:14337:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432866.241021:0:14337:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432866.241021:0:14337:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432866.241022:0:14337:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432866.241023:0:14337:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787432866.241024:0:14337:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787432866.241025:0:14337:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432866.241026:0:14337:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787432866.241058:0:14337:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787432866.241079:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad12300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812821888:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787432866.241149:0:14337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432866.241200:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432866.241373:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812821888 00000100:00100000:0.0:1787432866.241381:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812821888 00000100:00100000:0.0:1787432866.241433:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432866.241443:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b95016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+5:14337:x1874258812821888:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787432866.241490:0:14350:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787432866.241493:0:14350:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787432866.241497:0:14350:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787432866.251618:0:14371:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787432866.252486:0:14350:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1787432866.257606:0:14372:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787432866.257617:0:14372:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787432866.257620:0:14372:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787432866.262491:0:14372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1787432866.268305:0:14350:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787432866.268319:0:14350:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787432866.301883:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b95016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+5:14337:x1874258812821888:12345-0@lo:253:mount.lustre.0 Request processed in 60431us (60723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432866.301915:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787432866.308718:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad12300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812821888:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787432866.308754:0:14337:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787432866.308758:0:14337:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787432866.308761:0:14337:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787432866.308762:0:14337:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787432866.308763:0:14337:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787432866.308765:0:14337:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787432866.308766:0:14337:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787432866.308767:0:14337:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787432866.308769:0:14337:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787432866.308771:0:14337:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787432866.308772:0:14337:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787432866.308810:0:14337:0:(tgt_mount.c:101:server_register_mount()) register mount ffff935bbb47d000 from lustre-MDT0000 10000000:01000000:3.0:1787432866.308844:0:14337:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787432866.308846:0:14337:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787432866.308850:0:14337:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff935b91a83370 10000000:01000000:3.0:1787432866.308866:0:14337:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787432866.308873:0:14337:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff935b91a83370 from 1 10000000:01000000:3.0:1787432866.308875:0:14337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787432866.308923:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f10a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.308934:0:14337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f10a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.308944:0:14337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f10a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432866.308963:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad12300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812822016:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787432866.309031:0:14337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432866.309062:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787432866.309285:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812822016 00000100:00100000:0.0:1787432866.309292:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812822016 00000100:00100000:0.0:1787432866.309344:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432866.309354:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b95016050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+5:14337:x1874258812822016:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432866.309368:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432866.309383:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba1ce000/0xbcb9e331c3f10a7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f10a78 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.309406:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba1ce000/0xbcb9e331c3f10a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f10a78 expref: 6 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.309417:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba1ce000/0xbcb9e331c3f10a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10a78 expref: 6 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.309426:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1ce000, rc 0) 00000100:00100000:0.0:1787432866.309464:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b95016050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+6:14337:x1874258812822016:12345-0@lo:101:mount.lustre.0 Request processed in 113us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432866.309492:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787432866.310006:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad12300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812822016:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432866.310021:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f10a78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10a7f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.310031:0:14337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f10a78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f10a7f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432866.310091:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad12300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812822144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432866.310143:0:14337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432866.310174:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179c840 going to sleep for 11 seconds 00000100:00100000:1.0:1787432866.310287:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812822144 00000100:00100000:1.0:1787432866.310292:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812822144 00000100:00100000:1.0:1787432866.310327:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787432866.310335:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b95016450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+6:14337:x1874258812822144:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432866.310617:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b95016450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+6:14337:x1874258812822144:12345-0@lo:501:mount.lustre.0 Request processed in 282us (473us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787432866.310625:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432866.311242:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad12300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812822144:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787432866.311272:0:14337:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787432866.311293:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f10a78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10a7f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.311312:0:14337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f10a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10a7f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432866.311321:0:14337:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff935bbb47d000 10000000:01000000:3.0:1787432866.311326:0:14337:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787432866.311330:0:14337:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff935bbb47d000 10000000:01000000:3.0:1787432866.311333:0:14337:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787432866.311336:0:14337:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff935bbb47d000 from 1 10000000:01000000:3.0:1787432866.311339:0:14337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787432866.311366:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2154800/0xbcb9e331c3f10a86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.311374:0:14337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bc2154800/0xbcb9e331c3f10a86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.311382:0:14337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bc2154800/0xbcb9e331c3f10a86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432866.311398:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad12300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812822272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787432866.311431:0:14337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432866.311470:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787432866.311532:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812822272 00000100:00100000:0.0:1787432866.311537:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812822272 00000100:00100000:0.0:1787432866.311574:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432866.311583:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b95017c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+6:14337:x1874258812822272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432866.311593:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432866.311624:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba1cec00/0xbcb9e331c3f10a8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f10a86 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.311644:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba1cec00/0xbcb9e331c3f10a8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f10a86 expref: 7 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.311653:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba1cec00/0xbcb9e331c3f10a8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10a86 expref: 7 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.311701:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cec00, rc 0) 00000100:00100000:0.0:1787432866.311730:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b95017c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+7:14337:x1874258812822272:12345-0@lo:101:mount.lustre.0 Request processed in 149us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432866.311736:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787432866.313534:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad12300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812822272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432866.313555:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bc2154800/0xbcb9e331c3f10a86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10a8d expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.313566:0:14337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bc2154800/0xbcb9e331c3f10a86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f10a8d expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432866.313603:0:14337:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787432866.313624:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2154800/0xbcb9e331c3f10a86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10a8d expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.313630:0:14337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bc2154800/0xbcb9e331c3f10a86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10a8d expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432866.313636:0:14337:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787432866.313640:0:14337:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787432866.313645:0:14337:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff935bbb47d000 10000000:01000000:3.0:1787432866.313646:0:14337:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787432866.313649:0:14337:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787432866.313651:0:14337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787432866.313705:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2155200/0xbcb9e331c3f10a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.313714:0:14337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bc2155200/0xbcb9e331c3f10a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.313722:0:14337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bc2155200/0xbcb9e331c3f10a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432866.314052:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad12300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812822400:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787432866.314108:0:14337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432866.314187:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787432866.314247:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812822400 00000100:00100000:0.0:1787432866.314253:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812822400 00000100:00100000:0.0:1787432866.314306:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787432866.314315:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+7:14337:x1874258812822400:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432866.314329:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432866.314342:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba1cea00/0xbcb9e331c3f10a9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f10a94 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.314359:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba1cea00/0xbcb9e331c3f10a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f10a94 expref: 8 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.314373:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba1cea00/0xbcb9e331c3f10a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10a94 expref: 8 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.314380:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cea00, rc 0) 00000100:00100000:0.0:1787432866.314413:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+8:14337:x1874258812822400:12345-0@lo:101:mount.lustre.0 Request processed in 100us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432866.314418:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787432866.314506:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad12300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812822400:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432866.314515:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bc2155200/0xbcb9e331c3f10a94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10a9b expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.314527:0:14337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bc2155200/0xbcb9e331c3f10a94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f10a9b expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432866.314569:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad12300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812822528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432866.314594:0:14337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432866.314672:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179c840 going to sleep for 11 seconds 00000100:00100000:1.0:1787432866.319566:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812822528 00000100:00100000:1.0:1787432866.319584:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812822528 00000100:00100000:1.0:1787432866.319646:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787432866.319654:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+8:14337:x1874258812822528:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432866.320366:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+9:14337:x1874258812822528:12345-0@lo:501:mount.lustre.0 Request processed in 709us (5768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432866.320375:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787432866.320543:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad12300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812822528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432866.320594:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad12300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812822656:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787432866.320640:0:14337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432866.320698:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179c840 going to sleep for 11 seconds 00000100:00100000:2.0:1787432866.320930:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812822656 00000100:00100000:2.0:1787432866.320937:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812822656 00000100:00100000:2.0:1787432866.320972:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787432866.320980:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+9:14337:x1874258812822656:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787432866.321334:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+9:14337:x1874258812822656:12345-0@lo:503:mount.lustre.0 Request processed in 354us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432866.321342:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432866.322369:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad12300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812822656:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787432866.327144:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad12300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d00b432-f54a-428d-8e42-8523236fbac8:14373:1874258812822784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787432866.327236:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432866.327291:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787432866.328073:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812822784 00000100:00100000:2.0:1787432866.328084:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812822784 00000100:00100000:2.0:1787432866.328146:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787432866.328156:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+9:14373:x1874258812822784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432866.328501:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+9:14373:x1874258812822784:12345-0@lo:502:llog_process_th.0 Request processed in 346us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432866.328509:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787432866.329302:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad12300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d00b432-f54a-428d-8e42-8523236fbac8:14373:1874258812822784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787432866.329344:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432866.329355:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432866.329358:0:14373:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787432866.329363:0:14373:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787432866.329366:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787432866.329379:0:14373:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff935b8683b370) 00000020:00000080:3.0:1787432866.329399:0:14373:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787432866.329404:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787432866.329472:0:14373:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787432866.329479:0:14373:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbcb9e331c3f10aa9 00000020:00000080:3.0:1787432866.331243:0:14373:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787432866.331252:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432866.331257:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432866.331259:0:14373:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787432866.331262:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432866.331267:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432866.331268:0:14373:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787432866.331271:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787432866.331282:0:14373:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff935b868399b8) 00000020:00000080:3.0:1787432866.331298:0:14373:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787432866.331302:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787432866.331304:0:14373:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787432866.331307:0:14373:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787432866.331313:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787432866.331367:0:14373:0:(tgt_mount.c:153:server_get_mount()) get mount ffff935bbb47d000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787432866.331379:0:14373:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff935b86838000) 00000020:00000080:3.0:1787432866.331386:0:14373:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787432866.331462:0:14373:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787432866.331467:0:14373:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbcb9e331c3f10abe 00000020:00000080:3.0:1787432866.331572:0:14373:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787432866.331578:0:14373:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787432866.331582:0:14373:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbcb9e331c3f10ac5 00080000:01000000:3.0:1787432866.331588:0:14373:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787432866.331592:0:14373:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbcb9e331c3f10acc 00010000:00010000:1.0:1787432866.515976:0:14373:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1787432866.516560:0:14373:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1787432866.516968:0:14373:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787432866.517782:0:14373:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff935b907899b8) 00000020:00000080:1.0:1787432866.517826:0:14373:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787432866.517939:0:14373:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787432866.517947:0:14373:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbcb9e331c3f10ada 00000020:00000080:1.0:1787432866.526006:0:14373:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787432866.542700:0:14373:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbcb9e331c3f10ae1 00000020:00000080:1.0:1787432866.547287:0:14373:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787432866.547303:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432866.547310:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432866.547312:0:14373:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787432866.547316:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787432866.547318:0:14373:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1787432866.547320:0:14373:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787432866.547322:0:14373:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787432866.547323:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787432866.547326:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432866.547327:0:14373:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787432866.547330:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432866.547335:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432866.547336:0:14373:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787432866.547341:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787432866.547379:0:14373:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787432866.547394:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432866.547398:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432866.547399:0:14373:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787432866.547401:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787432866.547404:0:14373:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787432866.547408:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432866.547409:0:14373:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787432866.547412:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787432866.547417:0:14373:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.115@tcp to nid 0x20000c0a8ca73 (192.168.202.115@tcp) 00000020:01000000:1.0:1787432866.547445:0:14373:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787432866.547448:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787432866.547469:0:14373:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff935b90788000) 00000020:00000080:1.0:1787432866.547486:0:14373:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787432866.547492:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787432866.547547:0:14373:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787432866.547552:0:14373:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787432866.547559:0:14373:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbcb9e331c3f10aef 00010000:00080000:1.0:1787432866.547596:0:14373:0:(ldlm_lib.c:102:import_set_conn()) imp ffff935b857a6000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.115@tcp at head 00010000:00010000:1.0:1787432866.551093:0:14373:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1787432866.553908:0:14373:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787432866.553960:0:14373:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787432866.558844:0:14373:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787432866.558923:0:14373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787432866.558992:0:14373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787432866.562205:0:14377:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787432866.562211:0:14377:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787432866.563954:0:14373:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787432866.563968:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787432866.564007:0:14373:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787432866.564033:0:14373:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbcb9e331c3f10af6 00000100:00080000:0.0:1787432866.564046:0:14373:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787432866.564052:0:14373:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff935b857a6000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:0.0:1787432866.564375:0:14373:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff935bbad2a680 x1874258812822912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787432866.564407:0:14373:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1787432866.564503:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812822912:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787432866.564584:0:3329:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258812822912 offset 0 length 520: 4 00000020:01000000:0.0:1787432866.564755:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432866.564760:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432866.564762:0:14373:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787432866.564765:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787432866.564768:0:14373:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787432866.564770:0:14373:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787432866.564772:0:14373:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787432866.564773:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787432866.564776:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432866.564777:0:14373:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787432866.564780:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787432866.564785:0:14373:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787432866.564789:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432866.564798:0:14373:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787432866.564802:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787432866.564807:0:14373:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.115@tcp to nid 0x20000c0a8ca73 (192.168.202.115@tcp) 00000020:01000000:0.0:1787432866.564831:0:14373:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787432866.564834:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787432866.564850:0:14373:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff935b91a819b8) 00000020:00000080:0.0:1787432866.564864:0:14373:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787432866.564869:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787432866.564949:0:14373:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787432866.564957:0:14373:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787432866.564964:0:14373:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbcb9e331c3f10b04 00010000:00080000:0.0:1787432866.564998:0:14373:0:(ldlm_lib.c:102:import_set_conn()) imp ffff935b857b1800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.115@tcp at head 00010000:00010000:0.0:1787432866.565511:0:14373:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1787432866.567280:0:14373:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787432866.567313:0:14373:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787432866.568485:0:14373:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787432866.568559:0:14373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787432866.568643:0:14373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:1.0:1787432866.571484:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432866.571500:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d00b432-f54a-428d-8e42-8523236fbac8:3330:1874258812823040:0@lo:400:kworker.0 00000100:00100000:1.0:1787432866.571566:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432866.571615:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812823040 00000100:00100000:1.0:1787432866.571622:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812823040 00000100:00100000:1.0:1787432866.571675:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787432866.571684:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+9:3330:x1874258812823040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432866.571948:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+9:3330:x1874258812823040:12345-0@lo:400:kworker.0 Request processed in 264us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432866.571956:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787432866.572047:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d00b432-f54a-428d-8e42-8523236fbac8:3330:1874258812823040:0@lo:400:kworker.0 00000040:00080000:3.0:1787432866.572583:0:14379:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787432866.572588:0:14379:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787432866.574313:0:14373:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787432866.574327:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787432866.574363:0:14373:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787432866.574384:0:14373:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbcb9e331c3f10b0b 00000100:00080000:1.0:1787432866.574395:0:14373:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787432866.574400:0:14373:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff935b857b1800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787432866.574434:0:14373:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff935a8705fb80 x1874258812823168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787432866.574523:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812823168:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787432866.574577:0:3329:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258812823168 offset 0 length 520: 4 00000100:00080000:1.0:1787432866.574636:0:14373:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787432866.574757:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432866.574762:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432866.574763:0:14373:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787432866.574766:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432866.574770:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432866.574772:0:14373:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787432866.574774:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787432866.574776:0:14373:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787432866.574778:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432866.574781:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432866.574782:0:14373:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787432866.574784:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432866.574786:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432866.574787:0:14373:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787432866.574791:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787432866.574822:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d00b432-f54a-428d-8e42-8523236fbac8:14373:1874258812823296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432866.574917:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432866.574933:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b906d3480 going to sleep for 11 seconds 00000100:00100000:0.0:1787432866.577139:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812823296 00000100:00100000:0.0:1787432866.577152:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812823296 00000100:00100000:0.0:1787432866.577202:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787432866.577213:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+9:14373:x1874258812823296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432866.577512:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+9:14373:x1874258812823296:12345-0@lo:502:llog_process_th.0 Request processed in 301us (2595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432866.577521:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787432866.581226:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d00b432-f54a-428d-8e42-8523236fbac8:14373:1874258812823296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787432866.581284:0:14373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432866.581296:0:14373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432866.581299:0:14373:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787432866.581312:0:14373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787432866.582035:0:14337:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1787432866.582060:0:14337:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787432866.582080:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2155200/0xbcb9e331c3f10a94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10a9b expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432866.582102:0:14337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bc2155200/0xbcb9e331c3f10a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10a9b expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432866.582116:0:14337:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff935bbb47d000 from 1 10000000:01000000:1.0:1787432866.582118:0:14337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787432866.582155:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba8e6200/0xbcb9e331c3f10b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432866.582169:0:14337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bba8e6200/0xbcb9e331c3f10b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432866.582179:0:14337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bba8e6200/0xbcb9e331c3f10b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432866.582199:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812823424:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787432866.582256:0:14337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432866.582294:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2300 going to sleep for 11 seconds 00000100:00100000:0.0:1787432866.583941:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812823424 00000100:00100000:0.0:1787432866.583951:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812823424 00000100:00100000:0.0:1787432866.584009:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787432866.584019:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+9:14337:x1874258812823424:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432866.584034:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432866.584061:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba1ce400/0xbcb9e331c3f10b19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f10b12 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.584088:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba1ce400/0xbcb9e331c3f10b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f10b12 expref: 10 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.584114:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba1ce400/0xbcb9e331c3f10b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10b12 expref: 10 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.584124:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1ce400, rc 0) 00000100:00100000:0.0:1787432866.584180:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+10:14337:x1874258812823424:12345-0@lo:101:mount.lustre.0 Request processed in 163us (1924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432866.584187:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787432866.585627:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812823424:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432866.585649:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bba8e6200/0xbcb9e331c3f10b12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10b19 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432866.585698:0:14337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bba8e6200/0xbcb9e331c3f10b12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f10b19 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432866.587007:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812823552:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787432866.587350:0:14337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432866.587439:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2300 going to sleep for 11 seconds 00000100:00100000:0.0:1787432866.593325:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812823552 00000100:00100000:0.0:1787432866.593343:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812823552 00000100:00100000:0.0:1787432866.593424:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787432866.593436:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+10:14337:x1874258812823552:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787432866.593464:0:14350:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787432866.593471:0:14350:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787432866.593608:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+10:14337:x1874258812823552:12345-0@lo:256:mount.lustre.0 Request processed in 173us (6258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432866.593616:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787432866.599459:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812823552:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787432866.601536:0:14337:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787432866.601561:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba8e6200/0xbcb9e331c3f10b12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10b19 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.601574:0:14337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bba8e6200/0xbcb9e331c3f10b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10b19 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432866.601597:0:14337:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff935bbb47d000 from 1 10000000:01000000:0.0:1787432866.601600:0:14337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787432866.601644:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba1ce200/0xbcb9e331c3f10b20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.601652:0:14337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bba1ce200/0xbcb9e331c3f10b20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.601682:0:14337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bba1ce200/0xbcb9e331c3f10b20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432866.601714:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812823680:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787432866.601795:0:14337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432866.601840:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87b73300 going to sleep for 11 seconds 00000100:00100000:2.0:1787432866.601968:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812823680 00000100:00100000:2.0:1787432866.601976:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812823680 00000100:00100000:2.0:1787432866.602021:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787432866.602031:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+10:14337:x1874258812823680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432866.602043:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432866.602059:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bbaa5ee00/0xbcb9e331c3f10b27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f10b20 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432866.602081:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bbaa5ee00/0xbcb9e331c3f10b27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f10b20 expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432866.602090:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bbaa5ee00/0xbcb9e331c3f10b27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10b20 expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432866.602130:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5ee00, rc 0) 00000100:00100000:2.0:1787432866.602170:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+11:14337:x1874258812823680:12345-0@lo:101:mount.lustre.0 Request processed in 141us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432866.602178:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787432866.605507:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812823680:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432866.605535:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bba1ce200/0xbcb9e331c3f10b20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10b27 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.605547:0:14337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bba1ce200/0xbcb9e331c3f10b20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f10b27 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432866.605624:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812823808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432866.605732:0:14337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432866.605780:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87b73300 going to sleep for 11 seconds 00000100:00100000:3.0:1787432866.607132:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812823808 00000100:00100000:3.0:1787432866.607142:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812823808 00000100:00100000:3.0:1787432866.607215:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787432866.607226:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+11:14337:x1874258812823808:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432866.607842:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+11:14337:x1874258812823808:12345-0@lo:501:mount.lustre.0 Request processed in 616us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432866.607852:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787432866.608762:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812823808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432866.608820:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812823936:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432866.608885:0:14337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432866.608938:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87b73300 going to sleep for 11 seconds 00000100:00100000:0.0:1787432866.608956:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812823936 00000100:00100000:0.0:1787432866.608962:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812823936 00000100:00100000:0.0:1787432866.608995:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787432866.609003:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+11:14337:x1874258812823936:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432866.610524:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+11:14337:x1874258812823936:12345-0@lo:503:mount.lustre.0 Request processed in 1516us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432866.610536:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787432866.613478:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812823936:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432866.614069:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d00b432-f54a-428d-8e42-8523236fbac8:14381:1874258812824064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432866.614158:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432866.614201:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2000 going to sleep for 11 seconds 00000100:00100000:0.0:1787432866.614351:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812824064 00000100:00100000:0.0:1787432866.614358:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812824064 00000100:00100000:0.0:1787432866.614404:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787432866.614414:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+11:14381:x1874258812824064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432866.614727:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+11:14381:x1874258812824064:12345-0@lo:502:llog_process_th.0 Request processed in 313us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432866.614735:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787432866.615340:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d00b432-f54a-428d-8e42-8523236fbac8:14381:1874258812824064:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787432866.615373:0:14381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432866.615390:0:14381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432866.615393:0:14381:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787432866.615402:0:14381:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff935bbb47d000 00000020:00000080:1.0:1787432866.615404:0:14381:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787432866.615415:0:14381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432866.615418:0:14381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432866.615419:0:14381:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787432866.615422:0:14381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432866.615424:0:14381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432866.615426:0:14381:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787432866.615429:0:14381:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff935bbb47d000 00000020:00000080:1.0:1787432866.615431:0:14381:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787432866.615497:0:14381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432866.615501:0:14381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432866.615502:0:14381:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787432866.615505:0:14381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432866.615507:0:14381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432866.615508:0:14381:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787432866.615512:0:14381:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff935bbb47d000 00000020:00000080:1.0:1787432866.615514:0:14381:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787432866.615555:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d00b432-f54a-428d-8e42-8523236fbac8:14381:1874258812824192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787432866.615597:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432866.615622:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2000 going to sleep for 11 seconds 00000100:00100000:0.0:1787432866.617324:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812824192 00000100:00100000:0.0:1787432866.617335:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812824192 00000100:00100000:0.0:1787432866.617387:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787432866.617396:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+11:14381:x1874258812824192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432866.617623:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+11:14381:x1874258812824192:12345-0@lo:502:llog_process_th.0 Request processed in 227us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432866.617631:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787432866.617808:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d00b432-f54a-428d-8e42-8523236fbac8:14381:1874258812824192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787432866.617839:0:14381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432866.617846:0:14381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432866.617848:0:14381:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787432866.617852:0:14381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787432866.630009:0:14337:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787432866.630056:0:14337:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787432866.630084:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba1ce200/0xbcb9e331c3f10b20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10b27 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.630123:0:14337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bba1ce200/0xbcb9e331c3f10b20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10b27 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432866.630176:0:14337:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787432866.630179:0:14337:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff935bbb47d000 10000000:01000000:0.0:1787432866.630182:0:14337:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff935bbb47d000 10000000:01000000:0.0:1787432866.630186:0:14337:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787432866.630192:0:14337:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff935bbb47d000 from 1 10000000:01000000:0.0:1787432866.630195:0:14337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787432866.630231:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba1cf400/0xbcb9e331c3f10b2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.630238:0:14337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bba1cf400/0xbcb9e331c3f10b2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.630250:0:14337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bba1cf400/0xbcb9e331c3f10b2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432866.630275:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad2bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812824320:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787432866.630351:0:14337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432866.630393:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432866.630418:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812824320 00000100:00100000:0.0:1787432866.630424:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812824320 00000100:00100000:0.0:1787432866.630466:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787432866.630475:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+11:14337:x1874258812824320:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432866.630488:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432866.630501:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba1ce600/0xbcb9e331c3f10b35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f10b2e expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.630540:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba1ce600/0xbcb9e331c3f10b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f10b2e expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.630549:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba1ce600/0xbcb9e331c3f10b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10b2e expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.630558:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1ce600, rc 0) 00000100:00100000:0.0:1787432866.630598:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+12:14337:x1874258812824320:12345-0@lo:101:mount.lustre.0 Request processed in 124us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432866.630605:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787432866.630650:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad2bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812824320:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432866.630698:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bba1cf400/0xbcb9e331c3f10b2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10b35 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.630708:0:14337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bba1cf400/0xbcb9e331c3f10b2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f10b35 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432866.630762:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad2bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812824448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432866.630784:0:14337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432866.630804:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432866.630817:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812824448 00000100:00100000:0.0:1787432866.630820:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812824448 00000100:00100000:0.0:1787432866.630840:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787432866.630846:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+12:14337:x1874258812824448:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432866.631119:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+12:14337:x1874258812824448:12345-0@lo:501:mount.lustre.0 Request processed in 272us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432866.631135:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787432866.631163:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad2bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812824448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432866.631189:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad2bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812824576:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432866.631224:0:14337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432866.631235:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9179cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432866.631247:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812824576 00000100:00100000:0.0:1787432866.631251:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812824576 00000100:00100000:0.0:1787432866.631267:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787432866.631272:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbd6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+12:14337:x1874258812824576:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432866.631406:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbd6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+12:14337:x1874258812824576:12345-0@lo:503:mount.lustre.0 Request processed in 133us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432866.631413:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787432866.631449:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad2bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812824576:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787432866.633076:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d00b432-f54a-428d-8e42-8523236fbac8:14385:1874258812824704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432866.633170:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432866.633216:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b864bab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787432866.633389:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812824704 00000100:00100000:0.0:1787432866.633396:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812824704 00000100:00100000:0.0:1787432866.633448:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787432866.633460:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbd6bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+12:14385:x1874258812824704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432866.633915:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbd6bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+12:14385:x1874258812824704:12345-0@lo:502:llog_process_th.0 Request processed in 456us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432866.633924:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787432866.634990:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d00b432-f54a-428d-8e42-8523236fbac8:14385:1874258812824704:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787432866.635084:0:14385:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787432866.635116:0:14385:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff935bbae78000) 00000020:00000080:2.0:1787432866.635138:0:14385:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1787432866.635238:0:14385:0:(tgt_mount.c:153:server_get_mount()) get mount ffff935bbb47d000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787432866.635242:0:14385:0:(tgt_mount.c:187:server_put_mount()) put mount ffff935bbb47d000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787432866.635244:0:14385:0:(obd_mount.c:710:lustre_put_lsi()) put ffff935bbb47d000 4 00010000:00080000:2.0:1787432866.635283:0:14385:0:(ldlm_lib.c:102:import_set_conn()) imp ffff935b9089b000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.115@tcp at head 00010000:00010000:2.0:1787432866.639511:0:14385:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787432866.639741:0:14385:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787432866.639782:0:14385:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787432866.639795:0:14385:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbcb9e331c3f10b43 00000100:00080000:2.0:1787432866.639805:0:14385:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787432866.639811:0:14385:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff935b9089b000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:2.0:1787432866.639850:0:14385:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff935bbaa52a00 x1874258812824832/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432866.663393:0:14385:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787432866.680078:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874258812824832:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787432866.680175:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432866.680640:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812824832 00000100:00100000:1.0:1787432866.680649:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812824832 00000100:00100000:1.0:1787432866.680711:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432866.680720:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3329:x1874258812824832:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787432866.680794:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3329:x1874258812824832:12345-0@lo:38:llog_process_th.0 Request processed in 72us (618us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787432866.680800:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432866.682280:0:3329:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787432866.682291:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935b9089b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787432866.682304:0:3329:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787432866.682309:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874258812824832:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787432866.692373:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d00b432-f54a-428d-8e42-8523236fbac8:14385:1874258812824960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787432866.692460:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432866.694126:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b864ba9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432866.706804:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812824960 00000100:00100000:0.0:1787432866.706817:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812824960 00000100:00100000:0.0:1787432866.706869:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787432866.706880:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbd6bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+12:14385:x1874258812824960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787432866.707193:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbd6bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+12:14385:x1874258812824960:12345-0@lo:502:llog_process_th.0 Request processed in 314us (14732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432866.707201:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787432866.707269:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d00b432-f54a-428d-8e42-8523236fbac8:14385:1874258812824960:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787432866.707313:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787432866.707384:0:14337:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787432866.707406:0:14337:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787432866.707423:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba1cf400/0xbcb9e331c3f10b2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10b35 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432866.707434:0:14337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bba1cf400/0xbcb9e331c3f10b2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10b35 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787432866.707480:0:14337:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787432866.707482:0:14337:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787432866.707484:0:14337:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787432866.707485:0:14337:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787432866.707486:0:14337:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787432866.707488:0:14337:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787432866.707489:0:14337:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787432866.707490:0:14337:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787432866.707492:0:14337:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787432866.707494:0:14337:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787432866.707498:0:14337:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787432866.707504:0:14337:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787432866.707505:0:14337:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787432866.707506:0:14337:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787432866.707507:0:14337:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787432866.707508:0:14337:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787432866.707509:0:14337:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787432866.707510:0:14337:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787432866.707510:0:14337:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787432866.707511:0:14337:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787432866.707512:0:14337:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787432866.707533:0:14337:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787432866.707548:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812825088:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787432866.707582:0:14337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432866.707609:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91679f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432866.707844:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812825088 00000100:00100000:1.0:1787432866.707856:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812825088 00000100:00100000:1.0:1787432866.707893:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787432866.707912:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbd6b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+12:14337:x1874258812825088:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787432866.707934:0:14349:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787432866.707946:0:14349:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787432866.807433:0:14349:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787432866.807455:0:14349:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787432866.808349:0:14371:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787432866.808355:0:14371:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787432866.808379:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f10b4a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432866.808400:0:14371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bba1ce400/0xbcb9e331c3f10b19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10b12 expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432866.808408:0:14371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f10b4a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432866.808450:0:14371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bba1ce400/0xbcb9e331c3f10b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f10b12 expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432866.808466:0:14371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff935bba1ce400/0xbcb9e331c3f10b19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f10b12 expref: 12 pid: 14347 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432866.808481:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14371:1874258812825216:0@lo:104: 00000100:00100000:2.0:1787432866.808566:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432866.808621:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b8133a540 going to sleep for 11 seconds 00000100:00100000:3.0:1787432866.808724:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812825216 00000100:00100000:3.0:1787432866.808732:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812825216 00000100:00100000:3.0:1787432866.808782:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432866.808791:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d00b432-f54a-428d-8e42-8523236fbac8+3:14371:x1874258812825216:12345-0@lo:104: 00010000:00010000:3.0:1787432866.808803:0:14338:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bba8e6200/0xbcb9e331c3f10b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f10b19 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.808864:0:14338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787432866.808871:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d00b432-f54a-428d-8e42-8523236fbac8+3:14371:x1874258812825216:12345-0@lo:104: Request processed in 81us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432866.808877:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432866.808924:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14371:1874258812825216:0@lo:104: 00010000:00010000:3.0:1787432866.808945:0:14371:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f10b4a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.808963:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432866.808969:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bba8e6200/0xbcb9e331c3f10b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f10b19 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.808976:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6200 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:3.0:1787432866.808996:0:14344:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bba8e6200/0xbcb9e331c3f10b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f10b19 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.809006:0:14344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bba8e6200/0xbcb9e331c3f10b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f10b19 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787432866.809014:0:14344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bba8e6200/0xbcb9e331c3f10b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f10b19 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432866.809021:0:14344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787432866.809052:0:14344:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bba8e6200/0xbcb9e331c3f10b12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10b19 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.809058:0:14344:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787432866.809077:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bba8e6200/0xbcb9e331c3f10b12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10b19 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.809084:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bba8e6200/0xbcb9e331c3f10b12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10b19 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.809119:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432866.809121:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432866.809123:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432866.809154:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d00b432-f54a-428d-8e42-8523236fbac8:3332:1874258812825344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787432866.809186:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432866.809247:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812825344 00000100:00100000:3.0:1787432866.809251:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812825344 00010000:00010000:3.0:1787432866.809268:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bba1ce400/0xbcb9e331c3f10b19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f10b12 expref: 13 pid: 14347 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432866.809289:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432866.809301:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d00b432-f54a-428d-8e42-8523236fbac8+13:3332:x1874258812825344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787432866.809312:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432866.809317:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bba1ce400/0xbcb9e331c3f10b19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f10b12 expref: 13 pid: 14347 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.809327:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bba1ce400/0xbcb9e331c3f10b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f10b12 expref: 13 pid: 14347 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.809339:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bba1ce400/0xbcb9e331c3f10b19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f10b12 expref: 13 pid: 14347 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.809352:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f10b4a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.809360:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f10b4a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787432866.809371:0:14340:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001017694s 00010000:00010000:3.0:1787432866.809375:0:14340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f10b4a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.809382:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f10b4a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.809388:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f10b4a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.809395:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f10b4a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.809400:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5ea00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:3.0:1787432866.809409:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f10b4a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.809416:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f10b4a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.809429:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f10b4a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.809438:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432866.809468:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d00b432-f54a-428d-8e42-8523236fbac8+12:3332:x1874258812825344:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432866.809475:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787432866.809496:0:14371:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f10b4a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.809503:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f10b4a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432866.809510:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f10b4a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432866.809534:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d00b432-f54a-428d-8e42-8523236fbac8:3332:1874258812825344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787432866.835374:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbd6b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+11:14337:x1874258812825088:12345-0@lo:253:mount.lustre.0 Request processed in 127450us (127777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432866.835391:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787432866.835527:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:14337:1874258812825088:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787432866.835545:0:14337:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787432866.835549:0:14337:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787432866.835551:0:14337:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787432866.835553:0:14337:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787432866.835554:0:14337:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787432866.835555:0:14337:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787432866.835557:0:14337:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787432866.835558:0:14337:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787432866.835560:0:14337:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787432866.835562:0:14337:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787432866.835564:0:14337:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787432866.835577:0:14337:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787432866.845359:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787432866.845535:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787432866.845862:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787432866.846019:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787432866.851926:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787432866.852133:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787432866.855044:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787432866.856426:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787432866.862585:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787432866.863316:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787432866.863576:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787432866.863777:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1787432866.943677:0:14337:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00010000:00010000:2.0:1787432866.952037:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787432866.952308:0:14337:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787432866.952948:0:14394:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787432866.953058:0:14394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1787432866.954772:0:14393:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1787432866.954785:0:14393:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1787432866.958817:0:14337:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787432866.958959:0:14337:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787432866.959387:0:14337:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787432866.959396:0:14337:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787432866.959522:0:14337:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432866.960458:0:14337:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787432866.961585:0:14394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787432866.961653:0:14394:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787432866.961676:0:14394:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1787432866.972653:0:14337:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787432866.973081:0:14337:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1787432866.982311:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787432867.001804:0:14337:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1787432867.121595:0:14337:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787432867.121629:0:14337:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9ea40188f988 00100000:10000000:0.0:1787432867.121638:0:14337:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787432867.123694:0:14337:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787432867.123724:0:14337:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.115@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787432867.123740:0:14337:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787432867.123764:0:14337:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1787432867.766534:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787432867.957853:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787432868.022713:0:14353:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787432868.022722:0:14353:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff935bbb47d000 from 6 10000000:01000000:3.0:1787432868.022735:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787432868.022779:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f10b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432868.022792:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f10b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432868.022816:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f10b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432868.022841:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812825472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787432868.022929:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432868.022987:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b90705840 going to sleep for 11 seconds 00000100:00100000:0.0:1787432868.025086:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812825472 00000100:00100000:0.0:1787432868.025099:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812825472 00000100:00100000:0.0:1787432868.025161:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787432868.025172:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbd6ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+11:14353:x1874258812825472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432868.025187:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432868.025208:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba1cf800/0xbcb9e331c3f10b58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f10b51 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432868.025234:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba1cf800/0xbcb9e331c3f10b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f10b51 expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432868.025244:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba1cf800/0xbcb9e331c3f10b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10b51 expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432868.025253:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cf800, rc 0) 00000100:00100000:0.0:1787432868.025323:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbd6ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+12:14353:x1874258812825472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (2393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432868.025330:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787432868.025381:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812825472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432868.025399:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f10b51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10b58 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432868.025421:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f10b51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f10b58 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432868.025482:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812825600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787432868.025513:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432868.025547:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b864ba240 going to sleep for 11 seconds 00000100:00100000:2.0:1787432868.025552:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812825600 00000100:00100000:2.0:1787432868.025556:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812825600 00000100:00100000:2.0:1787432868.025582:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787432868.025646:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbd6bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+12:14353:x1874258812825600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787432868.025677:0:14349:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787432868.025692:0:14349:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787432868.025695:0:14349:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787432868.025769:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbd6bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+12:14353:x1874258812825600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432868.025776:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787432868.025806:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812825600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787432868.025849:0:14353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787432868.025857:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f10b51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10b58 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432868.025865:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f10b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10b58 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787432868.803264:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787432868.984317:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432870.006694:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432871.030726:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787432871.676869:0:12223:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432871.676878:0:12223:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787432871.676882:0:12223:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432871.676886:0:12223:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787432871.676889:0:12223:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787432871.676893:0:12223:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787432871.676898:0:12223:0:(import.c:65:import_set_state_nolock()) ffff935b9089b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787432871.676916:0:12223:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff935b9089b000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:0.0:1787432871.676948:0:12223:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff935bbad29180 x1874258812825856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787432871.676992:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432871.677020:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d00b432-f54a-428d-8e42-8523236fbac8:3332:1874258812825728:0@lo:400:kworker.0 00000100:00100000:0.0:1787432871.677146:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432871.677235:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874258812825856:0@lo:38:kworker.0 00000100:00100000:0.0:1787432871.677269:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432871.677314:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812825728 00000100:00100000:0.0:1787432871.677325:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812825728 00000100:00100000:0.0:1787432871.677399:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787432871.677410:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbd6b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+12:3332:x1874258812825728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432871.677474:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbd6b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+12:3332:x1874258812825728:12345-0@lo:400:kworker.0 Request processed in 65us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432871.677483:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787432871.677541:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d00b432-f54a-428d-8e42-8523236fbac8:3332:1874258812825728:0@lo:400:kworker.0 00000100:00100000:2.0:1787432871.677741:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812825856 00000100:00100000:2.0:1787432871.677747:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812825856 00000100:00100000:2.0:1787432871.677786:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432871.677793:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3329:x1874258812825856:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787432871.677822:0:14357:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:2.0:1787432871.677881:0:14357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbcb9e331c3f10b5f 00000004:00100000:2.0:1787432871.677901:0:14357:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787432871.678097:0:14357:0:(import.c:65:import_set_state_nolock()) ffff935b910a4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432871.678165:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3329:x1874258812825856:12345-0@lo:38:kworker.0 Request processed in 371us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432871.678172:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787432871.678216:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff935bbad29180 x1874258812825856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787432871.678232:0:3329:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787432871.678241:0:3329:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787432871.678247:0:3329:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787432871.678249:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935b9089b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787432871.678255:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3329:1874258812825856:0@lo:38:kworker.0 00010000:00010000:0.0:1787432872.060317:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432873.078010:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787432873.960052:0:14637:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787432874.110148:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432875.127969:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432876.150077:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432876.793514:0:3329:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432866/real 1787432866] req@ffff935a8705fb80 x1874258812823168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432876 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432876.793550:0:3329:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff935a8705fb80 x1874258812823168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432876 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432876.793561:0:3329:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432866/real 1787432866] req@ffff935bbad2a680 x1874258812822912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432876 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432876.793574:0:3329:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff935bbad2a680 x1874258812822912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432876 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787432876.793619:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935b857b1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787432876.802391:0:12223:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432876.802399:0:12223:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787432876.802402:0:12223:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432876.802405:0:12223:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787432876.802409:0:12223:0:(import.c:65:import_set_state_nolock()) ffff935b857b1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432876.802418:0:12223:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 501 00000100:00080000:3.0:1787432876.802426:0:12223:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787432876.802433:0:12223:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff935b857b1800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:3.0:1787432876.802441:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432876.802458:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d00b432-f54a-428d-8e42-8523236fbac8:3331:1874258812825984:0@lo:400:kworker.0 00000100:00100000:3.0:1787432876.802552:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432876.802650:0:12223:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff935bbad10380 x1874258812826112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787432876.802706:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3331:1874258812826240:0@lo:400:kworker.0 00000100:00100000:0.0:1787432876.802930:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812825984 00000100:00100000:0.0:1787432876.802939:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812825984 00000100:00100000:0.0:1787432876.802986:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787432876.802995:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbd6b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+12:3331:x1874258812825984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432876.803045:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbd6b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+12:3331:x1874258812825984:12345-0@lo:400:kworker.0 Request processed in 51us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432876.803052:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787432876.803132:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432876.803171:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d00b432-f54a-428d-8e42-8523236fbac8:3331:1874258812825984:0@lo:400:kworker.0 00000100:00100000:0.0:1787432876.803309:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812826240 00000100:00100000:0.0:1787432876.803313:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812826240 00000100:00100000:0.0:1787432876.803343:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787432876.803349:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3331:x1874258812826240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432876.803382:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3331:x1874258812826240:12345-0@lo:400:kworker.0 Request processed in 34us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432876.803389:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787432876.803648:0:3329:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787432876.803668:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812823168:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787432876.804081:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935b857a6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432876.804090:0:3329:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787432876.804093:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812822912:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787432876.804120:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812826112:0@lo:8:kworker.0 00000400:00000100:1.0:1787432876.804157:0:3329:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258812826112 offset 0 length 520: 4 00010000:00080000:3.0:1787432876.804312:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff935bbad13b80 x1874258812826240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432876.804325:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3331:1874258812826240:0@lo:400:kworker.0 00000100:00080000:3.0:1787432876.804345:0:12223:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432876.804350:0:12223:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787432876.804352:0:12223:0:(import.c:65:import_set_state_nolock()) ffff935b857a6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432876.804357:0:12223:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 501 00000100:00080000:3.0:1787432876.804360:0:12223:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787432876.804366:0:12223:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff935b857a6000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:3.0:1787432876.804388:0:12223:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff935bbad13b80 x1874258812826368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787432876.804621:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812826368:0@lo:8:kworker.0 00000400:00000100:1.0:1787432876.804647:0:3329:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874258812826368 offset 0 length 520: 4 00010000:00010000:3.0:1787432877.182862:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787432877.366125:0:14789:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef264d930 20000000:00000080:3.0:1787432877.366144:0:14789:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff935bb8751c00 uarg=0000000000000000 20000000:01000000:3.0:1787432877.366181:0:14789:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787432877.366188:0:14789:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787432877.366194:0:14789:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787432877.367015:0:14790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787432877.367160:0:14789:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787432877.373928:0:14789:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787432877.373964:0:14789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff935bbaa5f200/0xbcb9e331c3f10b66 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432877.373983:0:14789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bbaa5ee00/0xbcb9e331c3f10b27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10b20 expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432877.374008:0:14789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff935bbaa5f200/0xbcb9e331c3f10b66 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432877.374059:0:14789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bbaa5ee00/0xbcb9e331c3f10b27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f10b20 expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432877.374075:0:14789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff935bbaa5ee00/0xbcb9e331c3f10b27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f10b20 expref: 11 pid: 14350 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432877.374089:0:14789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14789:1874258812826496:0@lo:104: 00000100:00100000:2.0:1787432877.374161:0:14789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432877.374273:0:14789:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a87bd2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432877.374332:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812826496 00000100:00100000:1.0:1787432877.374341:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812826496 00000100:00100000:1.0:1787432877.374432:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787432877.374446:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d00b432-f54a-428d-8e42-8523236fbac8+3:14789:x1874258812826496:12345-0@lo:104: 00010000:00010000:1.0:1787432877.374462:0:14339:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bba1ce200/0xbcb9e331c3f10b20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f10b27 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432877.374542:0:14339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787432877.374549:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d00b432-f54a-428d-8e42-8523236fbac8+3:14789:x1874258812826496:12345-0@lo:104: Request processed in 107us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432877.374556:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787432877.374614:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432877.374622:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bba1ce200/0xbcb9e331c3f10b20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f10b27 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432877.374642:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1ce200 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:0.0:1787432877.374646:0:14344:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bba1ce200/0xbcb9e331c3f10b20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f10b27 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432877.374678:0:14344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bba1ce200/0xbcb9e331c3f10b20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f10b27 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432877.374687:0:14344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bba1ce200/0xbcb9e331c3f10b20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f10b27 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432877.374692:0:14344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787432877.374735:0:14344:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bba1ce200/0xbcb9e331c3f10b20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10b27 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432877.374741:0:14344:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432877.374765:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bba1ce200/0xbcb9e331c3f10b20 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10b27 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432877.374772:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bba1ce200/0xbcb9e331c3f10b20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10b27 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432877.374787:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432877.374789:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432877.374790:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432877.374823:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d00b432-f54a-428d-8e42-8523236fbac8:3332:1874258812826624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432877.374855:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432877.374898:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812826624 00000100:00100000:0.0:1787432877.374902:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812826624 00010000:00010000:0.0:1787432877.374920:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bbaa5ee00/0xbcb9e331c3f10b27 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f10b20 expref: 12 pid: 14350 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432877.374948:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432877.374954:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d00b432-f54a-428d-8e42-8523236fbac8+12:3332:x1874258812826624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432877.374965:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432877.374971:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bbaa5ee00/0xbcb9e331c3f10b27 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f10b20 expref: 12 pid: 14350 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432877.374981:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bbaa5ee00/0xbcb9e331c3f10b27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f10b20 expref: 12 pid: 14350 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432877.374999:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff935bbaa5f200/0xbcb9e331c3f10b66 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432877.375007:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bbaa5f200/0xbcb9e331c3f10b66 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432877.375020:0:14340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935bbaa5f200/0xbcb9e331c3f10b66 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432877.375028:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935bbaa5f200/0xbcb9e331c3f10b66 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432877.375034:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff935bbaa5f200/0xbcb9e331c3f10b66 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432877.375040:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff935bbaa5f200/0xbcb9e331c3f10b66 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432877.375045:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f200 already unused, calling callback (ffffffffc1752230) 00010000:00010000:0.0:1787432877.375049:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff935bbaa5f200/0xbcb9e331c3f10b66 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432877.375062:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff935bbaa5f200/0xbcb9e331c3f10b66 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432877.375072:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff935bbaa5f200/0xbcb9e331c3f10b66 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432877.375082:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432877.375112:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d00b432-f54a-428d-8e42-8523236fbac8+12:3332:x1874258812826624:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432877.375119:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432877.375157:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d00b432-f54a-428d-8e42-8523236fbac8:3332:1874258812826624:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787432877.375275:0:14789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bbaa5ee00/0xbcb9e331c3f10b27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f10b20 expref: 11 pid: 14350 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432877.375285:0:14789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14789:1874258812826496:0@lo:104: 00010000:00010000:2.0:1787432877.375302:0:14789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff935bbaa5f200/0xbcb9e331c3f10b66 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432877.375310:0:14789:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff935bbaa5f200/0xbcb9e331c3f10b66 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432877.375317:0:14789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff935bbaa5f200/0xbcb9e331c3f10b66 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432877.375324:0:14789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bbaa5f200/0xbcb9e331c3f10b66 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787432878.006325:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787432878.197980:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787432878.774785:0:14353:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787432878.774802:0:14353:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff935bbb47d000 from 10 10000000:01000000:1.0:1787432878.774808:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787432878.774857:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba8e6a00/0xbcb9e331c3f10b6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432878.774891:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bba8e6a00/0xbcb9e331c3f10b6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432878.774904:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bba8e6a00/0xbcb9e331c3f10b6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432878.774937:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812826752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787432878.775013:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432878.775062:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812826752 00000100:00100000:1.0:1787432878.775067:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a85036480 going to sleep for 11 seconds 00000100:00100000:3.0:1787432878.775074:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812826752 00000100:00100000:3.0:1787432878.775131:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787432878.775141:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbd6b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+11:14353:x1874258812826752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432878.775154:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432878.775168:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bc2154e00/0xbcb9e331c3f10b74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f10b6d expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432878.775191:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bc2154e00/0xbcb9e331c3f10b74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f10b6d expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432878.775201:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bc2154e00/0xbcb9e331c3f10b74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10b6d expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432878.775210:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bc2154e00, rc 0) 00000100:00100000:3.0:1787432878.775251:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbd6b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+12:14353:x1874258812826752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432878.775258:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787432878.775301:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812826752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432878.775314:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bba8e6a00/0xbcb9e331c3f10b6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10b74 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432878.775323:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bba8e6a00/0xbcb9e331c3f10b6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f10b74 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432878.775370:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812826880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432878.775391:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432878.775404:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b90705e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432878.775416:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812826880 00000100:00100000:3.0:1787432878.775425:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812826880 00000100:00100000:3.0:1787432878.775445:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787432878.775450:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbd6bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+12:14353:x1874258812826880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432878.775701:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbd6bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+12:14353:x1874258812826880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432878.775707:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787432878.775732:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812826880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432878.775758:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812827008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432878.775801:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432878.775820:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b90705e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432878.775830:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812827008 00000100:00100000:3.0:1787432878.775833:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812827008 00000100:00100000:3.0:1787432878.775852:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787432878.775857:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+12:14353:x1874258812827008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432878.775992:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+12:14353:x1874258812827008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432878.775998:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787432878.776031:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812827008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787432878.779403:0:14850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787432878.781632:0:14353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787432878.781691:0:14353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787432878.781705:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba8e6a00/0xbcb9e331c3f10b6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10b74 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432878.781718:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bba8e6a00/0xbcb9e331c3f10b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10b74 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432879.223858:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432880.246908:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432881.272981:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787432881.913075:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432881.913085:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787432881.913088:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432881.913091:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787432881.913167:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d00b432-f54a-428d-8e42-8523236fbac8:3333:1874258812827136:0@lo:400:kworker.0 00000100:00100000:0.0:1787432881.913277:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432881.913381:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874258812827264:0@lo:400:kworker.0 00000100:00100000:0.0:1787432881.913414:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432881.913451:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812827136 00000100:00100000:0.0:1787432881.913460:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812827136 00000100:00100000:0.0:1787432881.913509:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787432881.913517:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+12:3333:x1874258812827136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432881.913576:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+12:3333:x1874258812827136:12345-0@lo:400:kworker.0 Request processed in 58us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432881.913583:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787432881.913615:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812827264 00000100:00100000:0.0:1787432881.913619:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812827264 00000100:00100000:0.0:1787432881.913644:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432881.913651:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874258812827264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432881.913705:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874258812827264:12345-0@lo:400:kworker.0 Request processed in 55us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432881.913712:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787432881.913749:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff935bbad29180 x1874258812827264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432881.913776:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874258812827264:0@lo:400:kworker.0 00000100:00100000:0.0:1787432881.913805:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d00b432-f54a-428d-8e42-8523236fbac8:3333:1874258812827136:0@lo:400:kworker.0 00010000:00010000:1.0:1787432882.295011:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432883.318016:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787432883.598184:0:15038:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787432883.598189:0:15038:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787432883.598302:0:15038:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff935b87de8800 00000020:01000004:3.0:1787432883.598321:0:15038:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787432883.598335:0:15038:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787432883.598352:0:15038:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff935b8683cd28) 00000020:00000080:3.0:1787432883.598373:0:15038:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787432883.622050:0:15038:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787432883.622358:0:15038:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787432883.623376:0:15038:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787432883.623612:0:15038:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787432883.624057:0:15038:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787432883.624431:0:15038:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 545: rc = 0 00100000:10000000:3.0:1787432883.624519:0:15038:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 545: rc = 0 00100000:10000000:3.0:1787432883.624614:0:15038:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 545: rc = 0 00100000:10000000:3.0:1787432883.625895:0:15038:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:3.0:1787432883.626182:0:15038:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:3.0:1787432883.626433:0:15038:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:0.0:1787432883.628108:0:15038:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 770: rc = 0 00100000:10000000:0.0:1787432883.628467:0:15038:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 770: rc = 0 00100000:10000000:0.0:1787432883.629272:0:15038:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 770: rc = 0 00000020:00000080:0.0:1787432883.631303:0:15038:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787432883.631317:0:15038:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787432883.631330:0:15038:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbcb9e331c3f10b82 00000020:01000004:0.0:1787432883.631338:0:15038:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1787432883.631359:0:15038:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.115@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787432883.631362:0:15038:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787432883.631368:0:15038:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787432883.631373:0:15038:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787432883.631386:0:15038:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff935b91a80000) 00000020:00000080:0.0:1787432883.631407:0:15038:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1787432883.640127:0:15038:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787432883.640326:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787432883.640332:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787432883.640646:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787432883.640652:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787432883.651952:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787432883.651970:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787432883.654447:0:15038:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787432883.654919:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787432883.654928:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787432883.656969:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787432883.656986:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787432883.718418:0:15038:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787432883.719383:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787432883.719393:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787432883.723118:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787432883.723135:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787432883.724406:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787432883.724419:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787432883.730366:0:15038:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432883.730591:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787432883.730598:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787432883.736608:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787432883.736626:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787432883.798999:0:15038:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787432883.805432:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787432883.805446:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787432883.808256:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787432883.808270:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787432883.809220:0:15038:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787432883.809249:0:15038:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787432883.809255:0:15038:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.115@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787432883.830026:0:15038:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787432883.830065:0:15038:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.115@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787432883.830070:0:15038:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787432883.830072:0:15038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787432883.830074:0:15038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432883.830075:0:15038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432883.830076:0:15038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432883.830077:0:15038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432883.830079:0:15038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787432883.830082:0:15038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432883.830083:0:15038:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787432883.830088:0:15038:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787432883.830091:0:15038:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787432883.830092:0:15038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787432883.830093:0:15038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432883.830094:0:15038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432883.830095:0:15038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432883.830096:0:15038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432883.830097:0:15038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787432883.830099:0:15038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432883.830100:0:15038:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787432883.830129:0:15038:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787432883.830151:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812827392:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787432883.830475:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432883.830572:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b8304f780 going to sleep for 11 seconds 00000100:00100000:2.0:1787432883.830618:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812827392 00000100:00100000:2.0:1787432883.830626:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812827392 00000100:00100000:2.0:1787432883.830876:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787432883.830888:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+12:15038:x1874258812827392:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787432883.830925:0:14350:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787432883.830929:0:14350:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787432883.830934:0:14350:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787432883.840643:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+12:15038:x1874258812827392:12345-0@lo:253:mount.lustre.0 Request processed in 9746us (10156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432883.840681:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787432883.843929:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812827392:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787432883.843951:0:15038:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787432883.843955:0:15038:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787432883.843957:0:15038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787432883.843958:0:15038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432883.843959:0:15038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432883.843961:0:15038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432883.843962:0:15038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432883.843964:0:15038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787432883.843966:0:15038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432883.843967:0:15038:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787432883.844011:0:15038:0:(tgt_mount.c:101:server_register_mount()) register mount ffff935b87de8800 from lustre-OST0000 10000000:01000000:1.0:1787432883.844042:0:15038:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787432883.844045:0:15038:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787432883.844052:0:15038:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff935b91a83370 local copy 00010000:00010000:1.0:1787432883.844062:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f10a78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10a7f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432883.844485:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812827520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432883.844549:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432883.844902:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b86664300 going to sleep for 11 seconds 00000100:00100000:0.0:1787432883.846612:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812827520 00000100:00100000:0.0:1787432883.846628:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812827520 00000100:00100000:2.0:1787432883.846983:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787432883.846995:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+12:15038:x1874258812827520:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432883.847559:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+12:15038:x1874258812827520:12345-0@lo:501:mount.lustre.0 Request processed in 564us (3006us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787432883.847567:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787432883.848007:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812827520:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787432883.848036:0:15038:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787432883.848209:0:15038:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787432883.848219:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f10a78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10a7f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432883.848230:0:15038:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f10a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10a7f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432883.848269:0:15038:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff935b87de8800 10000000:01000000:1.0:1787432883.848274:0:15038:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787432883.848279:0:15038:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff935b91a83370 10000000:01000000:1.0:1787432883.848281:0:15038:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787432883.848284:0:15038:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff935b91a83370 from 1 10000000:01000000:1.0:1787432883.848287:0:15038:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787432883.848319:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba8e6600/0xbcb9e331c3f10b90 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432883.848328:0:15038:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bba8e6600/0xbcb9e331c3f10b90 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432883.848344:0:15038:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bba8e6600/0xbcb9e331c3f10b90 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432883.848363:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812827648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787432883.848402:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432883.850178:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b86664300 going to sleep for 11 seconds 00000100:00100000:3.0:1787432883.850227:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812827648 00000100:00100000:3.0:1787432883.850243:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812827648 00000100:00100000:2.0:1787432883.850405:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787432883.850416:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+12:15038:x1874258812827648:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432883.850430:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432883.850447:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bbaa5fe00/0xbcb9e331c3f10b97 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f10b90 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432883.850470:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bbaa5fe00/0xbcb9e331c3f10b97 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f10b90 expref: 13 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432883.850481:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bbaa5fe00/0xbcb9e331c3f10b97 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10b90 expref: 13 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432883.850490:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5fe00, rc 0) 00000100:00100000:2.0:1787432883.850555:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+13:15038:x1874258812827648:12345-0@lo:101:mount.lustre.0 Request processed in 141us (2152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432883.850562:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787432883.850687:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812827648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432883.850701:0:15038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bba8e6600/0xbcb9e331c3f10b90 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10b97 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432883.850711:0:15038:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bba8e6600/0xbcb9e331c3f10b90 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f10b97 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432883.850950:0:15038:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787432883.850967:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba8e6600/0xbcb9e331c3f10b90 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10b97 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432883.850975:0:15038:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bba8e6600/0xbcb9e331c3f10b90 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10b97 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432883.850982:0:15038:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787432883.850987:0:15038:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787432883.850992:0:15038:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787432883.850995:0:15038:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787432883.851018:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba8e7c00/0xbcb9e331c3f10b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432883.851025:0:15038:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bba8e7c00/0xbcb9e331c3f10b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432883.851040:0:15038:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bba8e7c00/0xbcb9e331c3f10b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432883.851056:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812827776:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787432883.851087:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432883.851106:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b86664300 going to sleep for 11 seconds 00000100:00100000:0.0:1787432883.851160:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812827776 00000100:00100000:0.0:1787432883.851164:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812827776 00000100:00100000:0.0:1787432883.851186:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787432883.851194:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+13:15038:x1874258812827776:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432883.851201:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432883.851209:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba1ce200/0xbcb9e331c3f10ba5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f10b9e expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432883.851222:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba1ce200/0xbcb9e331c3f10ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f10b9e expref: 14 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432883.851241:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba1ce200/0xbcb9e331c3f10ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10b9e expref: 14 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432883.851248:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1ce200, rc 0) 00000100:00100000:0.0:1787432883.851285:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+14:15038:x1874258812827776:12345-0@lo:101:mount.lustre.0 Request processed in 92us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432883.851291:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787432883.851442:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812827776:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432883.851452:0:15038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bba8e7c00/0xbcb9e331c3f10b9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10ba5 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432883.851459:0:15038:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bba8e7c00/0xbcb9e331c3f10b9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f10ba5 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787432883.852398:0:15038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787432883.854001:0:15038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787432883.854442:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787432883.854493:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787432883.854529:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787432883.854580:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787432883.854620:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787432883.854816:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787432883.854968:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787432883.854977:0:15038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787432883.855074:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812827904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432883.855144:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432883.855186:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b8304f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787432883.855297:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812827904 00000100:00100000:0.0:1787432883.855306:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812827904 00000100:00100000:0.0:1787432883.855354:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787432883.855364:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+14:15038:x1874258812827904:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432883.855860:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+14:15038:x1874258812827904:12345-0@lo:501:mount.lustre.0 Request processed in 497us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432883.856118:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787432883.856495:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812827904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432883.856544:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812828032:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432883.856585:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432883.856611:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b8304f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787432883.856683:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812828032 00000100:00100000:0.0:1787432883.856689:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812828032 00000100:00100000:0.0:1787432883.856713:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787432883.856721:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+14:15038:x1874258812828032:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432883.857118:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+14:15038:x1874258812828032:12345-0@lo:503:mount.lustre.0 Request processed in 397us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432883.857126:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787432883.857643:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812828032:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787432883.858616:0:15038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787432883.858987:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812828160:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432883.859064:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432883.859104:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b92147180 going to sleep for 11 seconds 00000100:00100000:3.0:1787432883.859198:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812828160 00000100:00100000:3.0:1787432883.859204:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812828160 00000100:00100000:3.0:1787432883.859371:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787432883.859389:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+14:15038:x1874258812828160:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432883.859650:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+14:15038:x1874258812828160:12345-0@lo:502:mount.lustre.0 Request processed in 262us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432883.859848:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787432883.859992:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812828160:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787432883.860541:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787432883.860607:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787432883.860640:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787432883.861178:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787432883.861228:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787432883.861397:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787432883.861448:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787432883.861485:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787432883.861522:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787432883.861567:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787432883.861602:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787432883.861647:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787432883.862028:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812828288:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432883.862112:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432883.863123:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a85036480 going to sleep for 11 seconds 00000100:00100000:3.0:1787432883.863357:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812828288 00000100:00100000:3.0:1787432883.863367:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812828288 00000100:00100000:2.0:1787432883.863568:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787432883.863578:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+14:15038:x1874258812828288:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432883.864123:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+14:15038:x1874258812828288:12345-0@lo:502:mount.lustre.0 Request processed in 544us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432883.864134:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787432883.864438:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812828288:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787432883.864554:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787432883.864572:0:15038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1787432883.872092:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787432883.872106:0:15052:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787432883.872115:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432883.872117:0:15052:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787432883.872123:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787432883.872141:0:15052:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff935b90628000) 00000020:00000080:3.0:1787432883.872172:0:15052:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787432883.872179:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787432883.872399:0:15052:0:(tgt_mount.c:153:server_get_mount()) get mount ffff935b87de8800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787432883.872409:0:15052:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787432883.872419:0:15052:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbcb9e331c3f10bb3 00010000:00010000:2.0:1787432883.887180:0:15052:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787432883.889136:0:15052:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787432883.891142:0:15052:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787432883.906139:0:15052:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787432883.906155:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432883.906162:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432883.906164:0:15052:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787432883.906168:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787432883.906171:0:15052:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1787432883.906173:0:15052:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787432883.906174:0:15052:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787432883.906176:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787432883.906179:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432883.906180:0:15052:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787432883.906183:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432883.906186:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432883.906187:0:15052:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787432883.906190:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787432883.906192:0:15052:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787432883.906195:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432883.906198:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432883.906208:0:15052:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787432883.906211:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787432883.906214:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432883.906215:0:15052:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787432883.906219:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787432883.906615:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787432883.906621:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432883.906622:0:15052:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787432883.906626:0:15052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787432883.907131:0:15038:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787432883.907159:0:15038:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787432883.907182:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba8e7c00/0xbcb9e331c3f10b9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10ba5 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432883.907209:0:15038:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bba8e7c00/0xbcb9e331c3f10b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10ba5 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787432883.907218:0:15038:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff935b87de8800 from 1 10000000:01000000:2.0:1787432883.907221:0:15038:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787432883.908388:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f600/0xbcb9e331c3f10bba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432883.908406:0:15038:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f600/0xbcb9e331c3f10bba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432883.908418:0:15038:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f600/0xbcb9e331c3f10bba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432883.908443:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812828416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787432883.908515:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432883.908571:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a850360c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432883.908931:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812828416 00000100:00100000:1.0:1787432883.908941:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812828416 00000100:00100000:1.0:1787432883.909003:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787432883.909013:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+14:15038:x1874258812828416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432883.909031:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432883.909047:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba8e6400/0xbcb9e331c3f10bc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f10bba expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432883.909076:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba8e6400/0xbcb9e331c3f10bc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f10bba expref: 15 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432883.909088:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba8e6400/0xbcb9e331c3f10bc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10bba expref: 15 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432883.909098:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e6400, rc 0) 00000100:00100000:1.0:1787432883.909159:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+15:15038:x1874258812828416:12345-0@lo:101:mount.lustre.0 Request processed in 147us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432883.909166:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787432883.914197:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812828416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432883.914244:0:15038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f600/0xbcb9e331c3f10bba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10bc1 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432883.915445:0:15038:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f600/0xbcb9e331c3f10bba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f10bc1 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787432883.921705:0:15038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787432883.932688:0:15038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432883.933355:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787432883.933404:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787432883.933491:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787432883.933500:0:15038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787432883.933606:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812828544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432883.934430:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432883.934907:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a850360c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432883.946328:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812828544 00000100:00100000:3.0:1787432883.946343:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812828544 00000100:00100000:3.0:1787432883.946401:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787432883.946412:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+15:15038:x1874258812828544:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432883.947039:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+15:15038:x1874258812828544:12345-0@lo:501:mount.lustre.0 Request processed in 626us (13311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432883.947048:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787432883.947241:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812828544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432883.947312:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812828672:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787432883.947364:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432883.947410:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a850360c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432883.947461:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812828672 00000100:00100000:0.0:1787432883.947465:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812828672 00000100:00100000:0.0:1787432883.947504:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787432883.947513:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+15:15038:x1874258812828672:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432883.947893:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+15:15038:x1874258812828672:12345-0@lo:503:mount.lustre.0 Request processed in 380us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432883.947901:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787432883.948452:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812828672:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787432883.949163:0:15038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787432883.949864:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812828800:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432883.949942:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432883.950062:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a850360c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432883.955976:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812828800 00000100:00100000:1.0:1787432883.955993:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812828800 00000100:00100000:1.0:1787432883.956959:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787432883.956975:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b90974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+15:15038:x1874258812828800:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432883.957333:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b90974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+15:15038:x1874258812828800:12345-0@lo:502:mount.lustre.0 Request processed in 362us (7390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432883.957341:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787432883.957502:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812828800:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787432883.958078:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787432883.958131:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787432883.958168:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787432883.958197:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787432883.958223:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787432883.958273:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787432883.958304:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787432883.958329:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787432883.958367:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812828928:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432883.958419:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432883.973589:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812828928 00000100:00100000:0.0:1787432883.973607:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812828928 00000100:00100000:3.0:1787432883.973627:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a850360c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432883.973706:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787432883.973717:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b90975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+15:15038:x1874258812828928:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432883.974135:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b90975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+15:15038:x1874258812828928:12345-0@lo:502:mount.lustre.0 Request processed in 420us (15715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432883.974145:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787432883.974415:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812828928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787432883.974586:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787432883.974604:0:15038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787432883.977140:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432883.977156:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432883.977159:0:15056:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787432883.977167:0:15056:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff935b87de8800 00000020:00000080:2.0:1787432883.977169:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787432883.977177:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432883.977179:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432883.977180:0:15056:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787432883.977182:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432883.977184:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432883.977185:0:15056:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787432883.977188:0:15056:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff935b87de8800 00000020:00000080:2.0:1787432883.977190:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787432883.977265:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432883.977269:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432883.977270:0:15056:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787432883.977273:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787432883.977276:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432883.977277:0:15056:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787432883.977281:0:15056:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff935b87de8800 00000020:00000080:2.0:1787432883.977283:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787432883.977315:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787432883.977318:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787432883.977319:0:15056:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787432883.977322:0:15056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787432883.977535:0:15038:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787432883.977559:0:15038:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787432883.977586:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f600/0xbcb9e331c3f10bba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10bc1 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432883.977598:0:15038:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f600/0xbcb9e331c3f10bba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10bc1 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432883.977684:0:15038:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787432883.977688:0:15038:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff935b87de8800 10000000:01000000:0.0:1787432883.977690:0:15038:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff935b87de8800 10000000:01000000:0.0:1787432883.977695:0:15038:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787432883.977700:0:15038:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff935b87de8800 from 1 10000000:01000000:0.0:1787432883.977703:0:15038:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787432883.977753:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba1cee00/0xbcb9e331c3f10bc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432883.977761:0:15038:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bba1cee00/0xbcb9e331c3f10bc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432883.977773:0:15038:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bba1cee00/0xbcb9e331c3f10bc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432883.977798:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad28380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812829056:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787432883.977869:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432883.977916:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b830540c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432883.978120:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812829056 00000100:00100000:2.0:1787432883.978127:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812829056 00000100:00100000:2.0:1787432883.978175:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787432883.978185:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b90976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+15:15038:x1874258812829056:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432883.978198:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432883.978216:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bbaa5e600/0xbcb9e331c3f10bcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f10bc8 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432883.978335:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bbaa5e600/0xbcb9e331c3f10bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f10bc8 expref: 16 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432883.978347:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bbaa5e600/0xbcb9e331c3f10bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10bc8 expref: 16 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432883.978356:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e600, rc 0) 00000100:00100000:2.0:1787432883.978404:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b90976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+16:15038:x1874258812829056:12345-0@lo:101:mount.lustre.0 Request processed in 220us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432883.978411:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787432883.978483:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad28380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812829056:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787432883.978496:0:15038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bba1cee00/0xbcb9e331c3f10bc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10bcf expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432883.978505:0:15038:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bba1cee00/0xbcb9e331c3f10bc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f10bcf expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787432883.980132:0:15038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787432883.980926:0:15038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787432883.981221:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787432883.981346:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787432883.981380:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787432883.981427:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787432883.981463:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787432883.981508:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787432883.981541:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787432883.981572:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787432883.988217:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787432883.988329:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787432883.988368:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787432883.988422:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787432883.988460:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787432883.988494:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787432883.988563:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787432883.988602:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787432883.988751:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787432883.988816:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787432883.988851:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787432883.988883:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787432883.988928:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787432883.988963:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787432883.988993:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787432883.989040:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787432883.989074:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787432883.989106:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787432883.989150:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787432883.989182:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787432883.989556:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787432883.989565:0:15038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787432883.989709:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812829184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432883.989792:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432883.991380:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a85036a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432883.991450:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812829184 00000100:00100000:1.0:1787432883.991460:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812829184 00000100:00100000:1.0:1787432883.991558:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787432883.991570:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba41a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+16:15038:x1874258812829184:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432883.991955:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba41a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+16:15038:x1874258812829184:12345-0@lo:501:mount.lustre.0 Request processed in 387us (2161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432883.991964:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787432883.992090:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812829184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432883.992140:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812829312:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787432883.992185:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432883.992381:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812829312 00000100:00100000:0.0:1787432883.992386:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812829312 00000100:00100000:0.0:1787432883.992413:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787432883.992427:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba41b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+16:15038:x1874258812829312:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432883.992640:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba41b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+16:15038:x1874258812829312:12345-0@lo:503:mount.lustre.0 Request processed in 214us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432883.992647:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787432883.994857:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a85036a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432883.994902:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812829312:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787432883.996355:0:15038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787432883.996456:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812829440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432883.996532:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432883.996960:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a85036a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432883.997007:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812829440 00000100:00100000:0.0:1787432883.997028:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812829440 00000100:00100000:1.0:1787432883.997512:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787432883.997523:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba418850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+16:15038:x1874258812829440:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432883.998066:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba418850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+16:15038:x1874258812829440:12345-0@lo:502:mount.lustre.0 Request processed in 544us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432883.998075:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787432883.998194:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812829440:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787432883.998546:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787432883.998598:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787432883.998629:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787432883.998824:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787432883.998877:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787432883.998930:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787432883.998964:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787432883.998996:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787432883.999042:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787432883.999078:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787432883.999111:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787432883.999159:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787432883.999194:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787432883.999226:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787432883.999354:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787432883.999388:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787432883.999419:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787432883.999462:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787432883.999491:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787432883.999518:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787432883.999586:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787432883.999619:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787432883.999651:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787432883.999847:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787432883.999884:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787432883.999914:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787432883.999963:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787432883.999995:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787432884.000028:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787432884.000078:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787432884.000109:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787432884.000136:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787432884.000167:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787432884.000211:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787432884.000395:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787432884.000445:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787432884.000498:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787432884.000528:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787432884.000577:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787432884.000610:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787432884.000866:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad28380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812829568:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432884.001028:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432884.001117:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b83054c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432884.001159:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812829568 00000100:00100000:2.0:1787432884.001166:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812829568 00000100:00100000:2.0:1787432884.001318:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787432884.001333:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba419050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+16:15038:x1874258812829568:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787432884.001569:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba419050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+16:15038:x1874258812829568:12345-0@lo:502:mount.lustre.0 Request processed in 237us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432884.001578:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787432884.001685:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad28380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812829568:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787432884.001783:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787432884.001798:0:15038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787432884.002983:0:15060:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787432884.003001:0:15060:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff935b91a84d28) 00000020:00000080:0.0:1787432884.003024:0:15060:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787432884.003097:0:15060:0:(tgt_mount.c:153:server_get_mount()) get mount ffff935b87de8800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787432884.003101:0:15060:0:(tgt_mount.c:187:server_put_mount()) put mount ffff935b87de8800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787432884.003103:0:15060:0:(obd_mount.c:710:lustre_put_lsi()) put ffff935b87de8800 3 00010000:00080000:0.0:1787432884.003134:0:15060:0:(ldlm_lib.c:102:import_set_conn()) imp ffff935b87c65800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.115@tcp at head 00010000:00010000:0.0:1787432884.008021:0:15060:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787432884.010420:0:15060:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787432884.010484:0:15060:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787432884.010499:0:15060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbcb9e331c3f10bdd 00000100:00080000:0.0:1787432884.010510:0:15060:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787432884.010516:0:15060:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff935b87c65800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:0.0:1787432884.010550:0:15060:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff935bbad28380 x1874258812829696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787432884.010618:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3329:1874258812829696:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787432884.010747:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787432884.010820:0:15060:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787432884.010847:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432884.010852:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787432884.010855:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432884.010858:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787432884.010906:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3331:1874258812829824:0@lo:400:kworker.0 00000100:00100000:0.0:1787432884.010936:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432884.010978:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812829696 00000100:00100000:0.0:1787432884.010985:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812829696 00000100:00100000:0.0:1787432884.011007:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812829824 00000100:00100000:0.0:1787432884.011010:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812829824 00000100:00100000:0.0:1787432884.011037:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432884.011045:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3331:x1874258812829824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432884.011096:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3331:x1874258812829824:12345-0@lo:400:kworker.0 Request processed in 51us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432884.011103:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432884.011117:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432884.011121:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3329:x1874258812829696:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787432884.011141:0:14355:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:0.0:1787432884.011190:0:14355:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbcb9e331c3f10be4 00000004:00100000:0.0:1787432884.011205:0:14355:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787432884.012847:0:14355:0:(import.c:65:import_set_state_nolock()) ffff935b87c66000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787432884.016480:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3329:x1874258812829696:12345-0@lo:38:llog_process_th.0 Request processed in 5345us (5730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432884.016497:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787432884.016590:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff935bbad29180 x1874258812829824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432884.016609:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3331:1874258812829824:0@lo:400:kworker.0 00010000:00080000:3.0:1787432884.017027:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff935bbad28380 x1874258812829696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432884.017038:0:3329:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787432884.017049:0:3329:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787432884.017058:0:3329:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787432884.017064:0:3329:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787432884.017068:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935b87c65800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787432884.017074:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3329:1874258812829696:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787432884.017322:0:15060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787432884.017774:0:15038:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787432884.017806:0:15038:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787432884.017823:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba1cee00/0xbcb9e331c3f10bc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10bcf expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432884.017835:0:15038:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bba1cee00/0xbcb9e331c3f10bc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10bcf expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787432884.017884:0:15038:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787432884.017887:0:15038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787432884.017888:0:15038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787432884.017889:0:15038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787432884.017891:0:15038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787432884.017892:0:15038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787432884.017893:0:15038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787432884.017895:0:15038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787432884.017897:0:15038:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787432884.017901:0:15038:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787432884.017904:0:15038:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787432884.017905:0:15038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787432884.017911:0:15038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787432884.017912:0:15038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787432884.017913:0:15038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787432884.017914:0:15038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787432884.017914:0:15038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787432884.017915:0:15038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787432884.017916:0:15038:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787432884.017940:0:15038:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787432884.017957:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad29180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812829952:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787432884.018025:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432884.018066:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b83054780 going to sleep for 11 seconds 00000100:00100000:1.0:1787432884.018371:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812829952 00000100:00100000:1.0:1787432884.018379:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812829952 00000100:00100000:1.0:1787432884.018438:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787432884.018456:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba419450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+16:15038:x1874258812829952:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787432884.018541:0:14349:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787432884.018554:0:14349:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787432884.046891:0:14349:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787432884.046920:0:14349:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787432884.047020:0:14371:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787432884.047026:0:14371:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787432884.047054:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f10beb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432884.047075:0:14371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bba1cf800/0xbcb9e331c3f10b58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10b51 expref: 16 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432884.047084:0:14371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f10beb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432884.047129:0:14371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bba1cf800/0xbcb9e331c3f10b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f10b51 expref: 16 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432884.047146:0:14371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff935bba1cf800/0xbcb9e331c3f10b58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f10b51 expref: 16 pid: 14347 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432884.047160:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad13480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14371:1874258812830080:0@lo:104: 00000100:00100000:3.0:1787432884.047225:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432884.047324:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b874e8900 going to sleep for 11 seconds 00000100:00100000:1.0:1787432884.048946:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812830080 00000100:00100000:1.0:1787432884.048962:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812830080 00000100:00100000:1.0:1787432884.049022:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432884.049032:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d00b432-f54a-428d-8e42-8523236fbac8+3:14371:x1874258812830080:12345-0@lo:104: 00010000:00010000:1.0:1787432884.049050:0:14339:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f10b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f10b58 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432884.049134:0:14339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787432884.049140:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d00b432-f54a-428d-8e42-8523236fbac8+3:14371:x1874258812830080:12345-0@lo:104: Request processed in 111us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432884.049147:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787432884.049185:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432884.049191:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f10b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f10b58 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432884.049198:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154600 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:1.0:1787432884.049203:0:14343:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f10b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f10b58 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432884.049213:0:14343:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f10b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f10b58 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787432884.049220:0:14343:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f10b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f10b58 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432884.049226:0:14343:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787432884.049289:0:14343:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f10b51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10b58 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432884.049296:0:14343:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787432884.049328:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f10b51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10b58 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432884.049335:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bc2154600/0xbcb9e331c3f10b51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10b58 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432884.049350:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d00b432-f54a-428d-8e42-8523236fbac8:3332:1874258812830208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787432884.049355:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432884.049356:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432884.049358:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432884.049388:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432884.049401:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad13480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14371:1874258812830080:0@lo:104: 00010000:00010000:1.0:1787432884.049422:0:14371:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f10beb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432884.049433:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812830208 00000100:00100000:0.0:1787432884.049436:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812830208 00010000:00010000:0.0:1787432884.049454:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bba1cf800/0xbcb9e331c3f10b58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f10b51 expref: 17 pid: 14347 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432884.049484:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432884.049491:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d00b432-f54a-428d-8e42-8523236fbac8+17:3332:x1874258812830208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432884.049502:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432884.049506:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bba1cf800/0xbcb9e331c3f10b58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f10b51 expref: 17 pid: 14347 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432884.049518:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bba1cf800/0xbcb9e331c3f10b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f10b51 expref: 17 pid: 14347 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432884.049533:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bba1cf800/0xbcb9e331c3f10b58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f10b51 expref: 17 pid: 14347 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432884.049557:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f10beb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432884.049565:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f10beb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787432884.049580:0:14340:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002554850s 00010000:00010000:0.0:1787432884.049584:0:14340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f10beb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432884.049591:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f10beb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432884.049597:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f10beb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432884.049604:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f10beb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432884.049609:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155000 already unused, calling callback (ffffffffc1752230) 00010000:00010000:0.0:1787432884.049613:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f10beb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432884.049620:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f10beb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432884.049636:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f10beb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432884.049646:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432884.049721:0:14371:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f10beb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432884.049730:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f10beb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432884.049736:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bc2155000/0xbcb9e331c3f10beb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432884.049884:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d00b432-f54a-428d-8e42-8523236fbac8+16:3332:x1874258812830208:12345-0@lo:103:ldlm_bl.0 Request processed in 392us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432884.049891:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432884.049916:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d00b432-f54a-428d-8e42-8523236fbac8:3332:1874258812830208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432884.059315:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba419450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+15:15038:x1874258812829952:12345-0@lo:253:mount.lustre.0 Request processed in 40848us (41277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432884.059334:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787432884.059363:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad29180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15038:1874258812829952:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787432884.059381:0:15038:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787432884.059385:0:15038:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787432884.059386:0:15038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787432884.059388:0:15038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787432884.059389:0:15038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787432884.059391:0:15038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787432884.059392:0:15038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787432884.059393:0:15038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787432884.059396:0:15038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787432884.059397:0:15038:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787432884.059414:0:15038:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787432884.064960:0:15038:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787432884.065136:0:15038:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787432884.065297:0:15038:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787432884.065452:0:15038:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787432884.065598:0:15038:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787432884.066099:0:15038:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787432884.067466:0:15038:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787432884.128852:0:15038:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787432884.128863:0:15038:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787432884.128929:0:15038:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787432884.129001:0:15038:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.115@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787432884.129021:0:15038:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787432884.129056:0:15038:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787432884.343898:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432885.366522:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787432885.366828:0:14353:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787432885.366833:0:14353:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff935bbb47d000 from 7 10000000:01000000:2.0:1787432885.366839:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787432885.366886:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fc00/0xbcb9e331c3f10bf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432885.366898:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fc00/0xbcb9e331c3f10bf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432885.366911:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fc00/0xbcb9e331c3f10bf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432885.366938:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812830336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787432885.367020:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432885.367076:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a8781ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432885.367847:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812830336 00000100:00100000:0.0:1787432885.367861:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812830336 00000100:00100000:0.0:1787432885.367925:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787432885.367935:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba419850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+15:14353:x1874258812830336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432885.367953:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432885.367970:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba1cfe00/0xbcb9e331c3f10bf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f10bf2 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432885.367999:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba1cfe00/0xbcb9e331c3f10bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f10bf2 expref: 16 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432885.368012:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba1cfe00/0xbcb9e331c3f10bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10bf2 expref: 16 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432885.368022:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cfe00, rc 0) 00000100:00100000:0.0:1787432885.368085:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba419850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+16:14353:x1874258812830336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432885.368091:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787432885.368162:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812830336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432885.368179:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fc00/0xbcb9e331c3f10bf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10bf9 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432885.368195:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fc00/0xbcb9e331c3f10bf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f10bf9 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432885.368266:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812830464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787432885.368301:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432885.368328:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff935bb9563a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432885.368342:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812830464 00000100:00100000:0.0:1787432885.368346:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812830464 00000100:00100000:0.0:1787432885.368369:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787432885.368376:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba418050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+16:14353:x1874258812830464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787432885.368390:0:14349:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787432885.368406:0:14349:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787432885.368409:0:14349:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787432885.368485:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba418050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+16:14353:x1874258812830464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432885.368493:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787432885.368522:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812830464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787432885.368576:0:14353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787432885.368584:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fc00/0xbcb9e331c3f10bf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10bf9 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432885.368594:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fc00/0xbcb9e331c3f10bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10bf9 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432886.389993:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432887.413875:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787432888.249798:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787432888.447334:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787432889.081981:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432889.082006:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787432889.082010:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787432889.082013:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787432889.082470:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432889.082497:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d00b432-f54a-428d-8e42-8523236fbac8:3332:1874258812830592:0@lo:400:kworker.0 00000100:00100000:0.0:1787432889.082601:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432889.082709:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874258812830720:0@lo:400:kworker.0 00000100:00100000:0.0:1787432889.082739:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432889.082759:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787432889.082824:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812830848:0@lo:400:kworker.0 00000100:00100000:0.0:1787432889.082854:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432889.082893:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812830592 00000100:00100000:0.0:1787432889.082907:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812830592 00000100:00100000:0.0:1787432889.082959:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787432889.082969:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba419c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+16:3332:x1874258812830592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432889.083140:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812830720 00000100:00100000:1.0:1787432889.083145:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812830720 00000100:00100000:1.0:1787432889.083179:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812830848 00000100:00100000:1.0:1787432889.083182:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812830848 00000100:00100000:1.0:1787432889.083214:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787432889.083222:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874258812830720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432889.089157:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874258812830720:12345-0@lo:400:kworker.0 Request processed in 5919us (6399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432889.089178:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787432889.089233:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787432889.089250:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812830848:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787432889.089968:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432889.090466:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812830848:12345-0@lo:400:kworker.0 Request processed in 1221us (7607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432889.090477:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432889.095343:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba419c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+16:3332:x1874258812830592:12345-0@lo:400:kworker.0 Request processed in 12343us (12711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432889.095366:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1787432889.095502:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bbad28700 x1874258812830848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432889.095523:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812830848:0@lo:400:kworker.0 00010000:00080000:0.0:1787432889.095541:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bbad28e00 x1874258812830720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432889.095552:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874258812830720:0@lo:400:kworker.0 00000100:00100000:3.0:1787432889.095959:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d00b432-f54a-428d-8e42-8523236fbac8:3332:1874258812830592:0@lo:400:kworker.0 00010000:00010000:0.0:1787432889.462441:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432890.488698:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432891.199635:0:3329:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432876/real 1787432876] req@ffff935bbad13b80 x1874258812826368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432891 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432891.199723:0:3329:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff935bbad13b80 x1874258812826368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432891 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432891.199735:0:3329:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787432876/real 1787432876] req@ffff935bbad10380 x1874258812826112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432891 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787432891.199747:0:3329:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff935bbad10380 x1874258812826112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787432891 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787432891.199767:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935b857a6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432891.199790:0:3329:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787432891.199795:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812826368:0@lo:8:kworker.0 00000100:00080000:1.0:1787432891.199801:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935b857b1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787432891.199807:0:3329:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787432891.199810:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812826112:0@lo:8:kworker.0 00000100:00080000:2.0:1787432891.200516:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432891.200521:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787432891.200525:0:8:0:(import.c:65:import_set_state_nolock()) ffff935b857a6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787432891.200531:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:2.0:1787432891.200537:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787432891.200546:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff935b857a6000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:2.0:1787432891.200564:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff935bbaa51180 x1874258812831104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787432891.200585:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432891.200589:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787432891.200590:0:8:0:(import.c:65:import_set_state_nolock()) ffff935b857b1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787432891.200594:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:2.0:1787432891.200596:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787432891.200601:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff935b857b1800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:2.0:1787432891.200612:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff935bbaa51880 x1874258812831232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787432891.200688:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812831360:0@lo:400:kworker.0 00000100:00100000:2.0:1787432891.200757:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432891.200818:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432891.200824:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d00b432-f54a-428d-8e42-8523236fbac8:3333:1874258812830976:0@lo:400:kworker.0 00000100:00100000:2.0:1787432891.200852:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432891.200884:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812831488:0@lo:400:kworker.0 00000100:00100000:2.0:1787432891.200912:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432891.200950:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812831360 00000100:00100000:2.0:1787432891.200957:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812831360 00000100:00100000:2.0:1787432891.200993:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812831488 00000100:00100000:2.0:1787432891.200996:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812831488 00000100:00100000:2.0:1787432891.201023:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432891.201031:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812831360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432891.201085:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812831360:12345-0@lo:400:kworker.0 Request processed in 55us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432891.201093:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432891.201112:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787432891.201126:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812831488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432891.201160:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812831488:12345-0@lo:400:kworker.0 Request processed in 35us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432891.201165:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787432891.201183:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812830976 00000100:00100000:2.0:1787432891.201187:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812830976 00000100:00100000:2.0:1787432891.201206:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787432891.201212:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba41a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+16:3333:x1874258812830976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432891.201239:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba41a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+16:3333:x1874258812830976:12345-0@lo:400:kworker.0 Request processed in 27us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432891.201244:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1787432891.201269:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432891.201292:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d00b432-f54a-428d-8e42-8523236fbac8:3333:1874258812830976:0@lo:400:kworker.0 00010000:00080000:2.0:1787432891.201305:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bbaa51c00 x1874258812831360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432891.201315:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812831360:0@lo:400:kworker.0 00010000:00080000:2.0:1787432891.201343:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bbaa51500 x1874258812831488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432891.201352:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812831488:0@lo:400:kworker.0 00000100:00100000:2.0:1787432891.201372:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812831104:0@lo:8:kworker.0 00000100:00100000:2.0:1787432891.201399:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432891.209594:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812831232:0@lo:8:kworker.0 00000100:00100000:2.0:1787432891.209695:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432891.209814:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812831104 00000100:00100000:1.0:1787432891.209824:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812831104 00000100:00100000:1.0:1787432891.209858:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812831232 00000100:00100000:1.0:1787432891.209862:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812831232 00000100:00100000:1.0:1787432891.209876:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432891.209882:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3329:x1874258812831104:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787432891.209912:0:15041:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:1.0:1787432891.209941:0:15041:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbcb9e331c3f10c00 00002000:00100000:1.0:1787432891.209959:0:15041:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff935b913ff000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787432891.209962:0:15041:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787432891.209965:0:15041:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787432891.210332:0:15041:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787432891.210361:0:15041:0:(import.c:65:import_set_state_nolock()) ffff935b913f8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787432891.210539:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3329:x1874258812831104:12345-0@lo:8:kworker.0 Request processed in 655us (9138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432891.210548:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432891.210568:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787432891.210573:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3329:x1874258812831232:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787432891.210585:0:15041:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787432891.210612:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3329:x1874258812831232:12345-0@lo:8:kworker.0 Request processed in 38us (918us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787432891.210619:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787432891.210745:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bbaa51180 x1874258812831104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787432911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432891.210766:0:3329:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787432891.210776:0:3329:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787432891.210785:0:3329:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787432891.210789:0:3329:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787432891.210792:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935b857a6000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787432891.210816:0:3329:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787432891.210823:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812831104:0@lo:8:kworker.0 00000100:00080000:2.0:1787432891.210837:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935b857b1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787432891.210841:0:3329:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787432891.210843:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812831232:0@lo:8:kworker.0 00000004:00080000:3.0:1787432891.210912:0:14377:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787432891.211260:0:14377:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 525876602251ns, next at 0ns, rc = 0 00000004:00080000:1.0:1787432891.213431:0:14378:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1787432891.213462:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14378:1874258812831744:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787432891.213528:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432891.213558:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b989d5240 going to sleep for 11 seconds 00000100:00100000:2.0:1787432891.213708:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432891.213723:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812831616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787432891.213756:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432891.213799:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812831744 00000100:00100000:2.0:1787432891.213806:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812831744 00000100:00100000:2.0:1787432891.213861:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787432891.213872:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14378:x1874258812831744:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1787432891.215744:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432891.215843:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812831616 00000100:00100000:1.0:1787432891.215852:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812831616 00000100:00100000:1.0:1787432891.215906:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432891.215916:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3330:x1874258812831616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432891.215953:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432891.216044:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3330:x1874258812831616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (2287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432891.216051:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787432891.218927:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935a8705d180 x1874258812831616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432891.218963:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812831616:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1787432891.221298:0:15042:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787432891.221312:0:15042:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787432891.221318:0:15042:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:2.0:1787432891.243007:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787432891.243020:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076dd539a/0xbcb9e331c3f10c07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.243036:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1787432891.243051:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432891.243059:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076dd539a/0xbcb9e331c3f10c07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.243079:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076dd539a/0xbcb9e331c3f10c07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.243090:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076dd539a/0xbcb9e331c3f10c07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.243098:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076dd539a/0xbcb9e331c3f10c07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.243121:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432891.243135:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432891.243142:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076dd539a/0xbcb9e331c3f10c07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.243151:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5ee00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432891.243156:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076dd539a/0xbcb9e331c3f10c07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.243166:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076dd539a/0xbcb9e331c3f10c07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.243182:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076dd539a/0xbcb9e331c3f10c07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.243202:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076dd539a/0xbcb9e331c3f10c07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.243225:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.243228:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.243230:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787432891.244181:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787432891.244190:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea745c8d/0xbcb9e331c3f10c0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.244202:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1787432891.244206:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432891.244212:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea745c8d/0xbcb9e331c3f10c0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.244223:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea745c8d/0xbcb9e331c3f10c0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.244232:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea745c8d/0xbcb9e331c3f10c0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.244240:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea745c8d/0xbcb9e331c3f10c0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.244259:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432891.244270:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432891.244282:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea745c8d/0xbcb9e331c3f10c0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.244289:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f200 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432891.244293:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea745c8d/0xbcb9e331c3f10c0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.244301:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea745c8d/0xbcb9e331c3f10c0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.244314:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea745c8d/0xbcb9e331c3f10c0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.246050:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea745c8d/0xbcb9e331c3f10c0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.246085:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.246087:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.246091:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787432891.251207:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787432891.251221:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034d6b7f2/0xbcb9e331c3f10c15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.251239:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1787432891.251244:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432891.251250:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034d6b7f2/0xbcb9e331c3f10c15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.251277:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034d6b7f2/0xbcb9e331c3f10c15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.251287:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034d6b7f2/0xbcb9e331c3f10c15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.251295:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034d6b7f2/0xbcb9e331c3f10c15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.251321:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432891.252789:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432891.252801:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034d6b7f2/0xbcb9e331c3f10c15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.252813:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f000 already unused, calling callback (ffffffffc1752230) 00010000:00010000:3.0:1787432891.252818:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034d6b7f2/0xbcb9e331c3f10c15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.252830:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034d6b7f2/0xbcb9e331c3f10c15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.252852:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034d6b7f2/0xbcb9e331c3f10c15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.252860:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034d6b7f2/0xbcb9e331c3f10c15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.252886:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432891.252888:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432891.252890:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787432891.256097:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787432891.256117:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076dd539a/0xbcb9e331c3f10c1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.256137:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1787432891.256143:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432891.256151:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076dd539a/0xbcb9e331c3f10c1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.256167:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076dd539a/0xbcb9e331c3f10c1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.256180:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076dd539a/0xbcb9e331c3f10c1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.256203:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076dd539a/0xbcb9e331c3f10c1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.256225:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432891.256240:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432891.256246:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076dd539a/0xbcb9e331c3f10c1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.256254:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5ee00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432891.256259:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076dd539a/0xbcb9e331c3f10c1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.256267:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076dd539a/0xbcb9e331c3f10c1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.256286:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076dd539a/0xbcb9e331c3f10c1c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.256293:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076dd539a/0xbcb9e331c3f10c1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.256309:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.256311:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.256313:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787432891.256900:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787432891.256917:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003491d711/0xbcb9e331c3f10c23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.256926:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1787432891.256930:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432891.256934:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003491d711/0xbcb9e331c3f10c23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.256943:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003491d711/0xbcb9e331c3f10c23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.256952:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003491d711/0xbcb9e331c3f10c23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.256959:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003491d711/0xbcb9e331c3f10c23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.256976:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787432891.257358:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787432891.257364:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a6d50f4/0xbcb9e331c3f10c2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.257372:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1787432891.257375:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432891.257378:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a6d50f4/0xbcb9e331c3f10c2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.257387:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a6d50f4/0xbcb9e331c3f10c2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.257401:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a6d50f4/0xbcb9e331c3f10c2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.257407:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a6d50f4/0xbcb9e331c3f10c2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.257421:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787432891.257434:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787432891.257439:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003491d711/0xbcb9e331c3f10c23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.257446:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e200 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432891.257450:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003491d711/0xbcb9e331c3f10c23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.257458:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003491d711/0xbcb9e331c3f10c23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.257472:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003491d711/0xbcb9e331c3f10c23 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.257479:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003491d711/0xbcb9e331c3f10c23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.257494:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432891.257503:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a6d50f4/0xbcb9e331c3f10c2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.257509:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f400 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432891.257512:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a6d50f4/0xbcb9e331c3f10c2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.257520:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a6d50f4/0xbcb9e331c3f10c2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.257530:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a6d50f4/0xbcb9e331c3f10c2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.257537:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a6d50f4/0xbcb9e331c3f10c2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.257550:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.257552:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.257553:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787432891.258001:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787432891.258008:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a633547/0xbcb9e331c3f10c31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.258018:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1787432891.258021:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432891.258025:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a633547/0xbcb9e331c3f10c31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.258047:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a633547/0xbcb9e331c3f10c31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.258056:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a633547/0xbcb9e331c3f10c31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.258063:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a633547/0xbcb9e331c3f10c31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.258078:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432891.258088:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432891.258092:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a633547/0xbcb9e331c3f10c31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.258098:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e000 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432891.258102:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a633547/0xbcb9e331c3f10c31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.258109:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a633547/0xbcb9e331c3f10c31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.258120:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a633547/0xbcb9e331c3f10c31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.258126:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a633547/0xbcb9e331c3f10c31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.258147:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.258149:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.258151:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787432891.258560:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787432891.258566:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f10c38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.258575:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=525s v=(0 0) 00010000:00010000:2.0:1787432891.258578:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432891.258582:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f10c38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.258590:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f10c38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.258598:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f10c38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.258605:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f10c38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.258619:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432891.258626:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432891.258630:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f10c38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.258648:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f800 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432891.258651:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f10c38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.259232:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432891.264439:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432891.264452:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f10c3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.264470:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787432891.264474:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432891.264481:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f10c3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.264494:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f10c3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.264504:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f10c3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.264511:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f10c3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.264529:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432891.265497:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f10c38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.265521:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f10c38 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.265530:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007d806db/0xbcb9e331c3f10c38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.265549:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432891.265554:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f10c3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.265561:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155000 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432891.265565:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f10c3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.265572:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f10c3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.265581:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f10c3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.265598:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9570f3c/0xbcb9e331c3f10c3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.265611:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.265613:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.265615:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432891.266729:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432891.266741:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000608d63ee/0xbcb9e331c3f10c46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.266906:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787432891.266911:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432891.266918:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000608d63ee/0xbcb9e331c3f10c46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.266947:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000608d63ee/0xbcb9e331c3f10c46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.266957:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000608d63ee/0xbcb9e331c3f10c46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.266965:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000608d63ee/0xbcb9e331c3f10c46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.266981:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787432891.267375:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432891.267381:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f672b318/0xbcb9e331c3f10c4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.267389:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787432891.267392:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432891.267397:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f672b318/0xbcb9e331c3f10c4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.267406:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f672b318/0xbcb9e331c3f10c4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.267424:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f672b318/0xbcb9e331c3f10c4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.267432:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f672b318/0xbcb9e331c3f10c4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.267440:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787432891.268063:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432891.268069:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd09371d/0xbcb9e331c3f10c54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.268078:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787432891.268081:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432891.268085:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd09371d/0xbcb9e331c3f10c54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.268094:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd09371d/0xbcb9e331c3f10c54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.268101:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd09371d/0xbcb9e331c3f10c54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.268107:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd09371d/0xbcb9e331c3f10c54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.268126:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787432891.268939:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787432891.268949:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000608d63ee/0xbcb9e331c3f10c46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.268961:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155c00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432891.268966:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000608d63ee/0xbcb9e331c3f10c46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.268977:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000608d63ee/0xbcb9e331c3f10c46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.268997:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000608d63ee/0xbcb9e331c3f10c46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269005:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000608d63ee/0xbcb9e331c3f10c46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269027:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787432891.269031:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f672b318/0xbcb9e331c3f10c4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269045:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2155600 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432891.269049:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f672b318/0xbcb9e331c3f10c4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269057:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f672b318/0xbcb9e331c3f10c4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432891.269067:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787432891.269068:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f672b318/0xbcb9e331c3f10c4d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.269079:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f10c5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269081:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f672b318/0xbcb9e331c3f10c4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.269101:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787432891.269106:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787432891.269108:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432891.269111:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f10c5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269113:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd09371d/0xbcb9e331c3f10c54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269132:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154000 already unused, calling callback (ffffffffc1752230) 00010000:00010000:3.0:1787432891.269136:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f10c5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269136:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd09371d/0xbcb9e331c3f10c54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269162:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd09371d/0xbcb9e331c3f10c54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.269163:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f10c5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.269185:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f10c5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269185:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd09371d/0xbcb9e331c3f10c54 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.269195:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432891.269203:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd09371d/0xbcb9e331c3f10c54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269220:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432891.269223:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f10c5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269230:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2154600 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432891.269233:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f10c5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269240:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f10c5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269250:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f10c5b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269257:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af5490fb/0xbcb9e331c3f10c5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269270:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.269273:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.269275:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432891.269691:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432891.269698:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a1e87af/0xbcb9e331c3f10c62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.269707:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787432891.269717:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432891.269722:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a1e87af/0xbcb9e331c3f10c62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.269731:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a1e87af/0xbcb9e331c3f10c62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.269740:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a1e87af/0xbcb9e331c3f10c62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.269819:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a1e87af/0xbcb9e331c3f10c62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.269844:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432891.269852:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432891.269858:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a1e87af/0xbcb9e331c3f10c62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269871:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031a00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432891.269874:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a1e87af/0xbcb9e331c3f10c62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269882:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a1e87af/0xbcb9e331c3f10c62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269893:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a1e87af/0xbcb9e331c3f10c62 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269899:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a1e87af/0xbcb9e331c3f10c62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.269918:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.269920:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.269923:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432891.270321:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432891.270328:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1400419/0xbcb9e331c3f10c69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.270343:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787432891.270347:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432891.270352:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1400419/0xbcb9e331c3f10c69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.270361:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1400419/0xbcb9e331c3f10c69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.270370:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1400419/0xbcb9e331c3f10c69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.270383:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1400419/0xbcb9e331c3f10c69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.270403:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432891.270409:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432891.270416:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1400419/0xbcb9e331c3f10c69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.270423:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031e00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432891.270428:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1400419/0xbcb9e331c3f10c69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.270436:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1400419/0xbcb9e331c3f10c69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.270454:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1400419/0xbcb9e331c3f10c69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.270461:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1400419/0xbcb9e331c3f10c69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.270478:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.270480:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.270483:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432891.271653:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432891.271695:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011a55979/0xbcb9e331c3f10c70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.271709:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787432891.271712:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432891.271717:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011a55979/0xbcb9e331c3f10c70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.271726:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011a55979/0xbcb9e331c3f10c70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.271735:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011a55979/0xbcb9e331c3f10c70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.271743:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011a55979/0xbcb9e331c3f10c70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.271900:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787432891.272206:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432891.272214:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011a55979/0xbcb9e331c3f10c70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.272224:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031000 already unused, calling callback (ffffffffc1752230) 00010000:00010000:0.0:1787432891.272229:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011a55979/0xbcb9e331c3f10c70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.272238:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011a55979/0xbcb9e331c3f10c70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.272256:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011a55979/0xbcb9e331c3f10c70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.272264:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011a55979/0xbcb9e331c3f10c70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.272285:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432891.272288:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432891.272290:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432891.272448:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432891.272456:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10c77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.272472:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787432891.272475:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432891.272480:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10c77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.272489:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10c77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.272498:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10c77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.272506:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10c77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.272901:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787432891.275966:0:5889:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1787432891.276938:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432891.276952:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000656005ad/0xbcb9e331c3f10c7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.276970:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787432891.276975:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432891.276982:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000656005ad/0xbcb9e331c3f10c7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.276997:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000656005ad/0xbcb9e331c3f10c7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.277033:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000656005ad/0xbcb9e331c3f10c7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.277041:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000656005ad/0xbcb9e331c3f10c7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.277540:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787432891.277550:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10c77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.277567:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030400 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432891.277568:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432891.277573:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10c77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.277583:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10c77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.277612:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10c77 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.277618:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10c77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.277654:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432891.277681:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432891.277684:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432891.277958:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:3.0:1787432891.278562:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432891.278570:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0743d10/0xbcb9e331c3f10c85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.278582:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787432891.278586:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432891.279916:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0743d10/0xbcb9e331c3f10c85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.279938:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0743d10/0xbcb9e331c3f10c85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.279949:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0743d10/0xbcb9e331c3f10c85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.279958:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0743d10/0xbcb9e331c3f10c85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.282019:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432891.282037:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0743d10/0xbcb9e331c3f10c85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.282051:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031800 already unused, calling callback (ffffffffc1752230) 00010000:00010000:0.0:1787432891.282057:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0743d10/0xbcb9e331c3f10c85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.282069:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0743d10/0xbcb9e331c3f10c85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.282110:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0743d10/0xbcb9e331c3f10c85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.282123:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432891.282125:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432891.282128:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432891.282385:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787432891.282394:0:15042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0743d10/0xbcb9e331c3f10c85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432891.284840:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432891.284854:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc1302b8/0xbcb9e331c3f10c8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.284870:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787432891.284874:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432891.284880:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc1302b8/0xbcb9e331c3f10c8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.284894:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc1302b8/0xbcb9e331c3f10c8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.284905:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc1302b8/0xbcb9e331c3f10c8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.284914:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc1302b8/0xbcb9e331c3f10c8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.285066:0:15366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432891.285075:0:15366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc1302b8/0xbcb9e331c3f10c8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.285096:0:15366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031200 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432891.285101:0:15366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc1302b8/0xbcb9e331c3f10c8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.285111:0:15366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc1302b8/0xbcb9e331c3f10c8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.285132:0:15366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc1302b8/0xbcb9e331c3f10c8c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.285142:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432891.285146:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.285252:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000656005ad/0xbcb9e331c3f10c7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.285262:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030200 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432891.285265:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000656005ad/0xbcb9e331c3f10c7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.285272:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000656005ad/0xbcb9e331c3f10c7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.285283:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000656005ad/0xbcb9e331c3f10c7e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.285290:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000656005ad/0xbcb9e331c3f10c7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.285324:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.285326:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432891.286441:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432891.286892:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787432891.286903:0:15042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc1302b8/0xbcb9e331c3f10c8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432891.287583:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432891.287606:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d24cf9a/0xbcb9e331c3f10c93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.287620:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787432891.287625:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432891.287638:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d24cf9a/0xbcb9e331c3f10c93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.287651:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d24cf9a/0xbcb9e331c3f10c93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.287695:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d24cf9a/0xbcb9e331c3f10c93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.287703:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d24cf9a/0xbcb9e331c3f10c93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.287715:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432891.287937:0:15366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432891.287947:0:15366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d24cf9a/0xbcb9e331c3f10c93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.287957:0:15366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030800 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432891.287962:0:15366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d24cf9a/0xbcb9e331c3f10c93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.287972:0:15366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d24cf9a/0xbcb9e331c3f10c93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.287991:0:15366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d24cf9a/0xbcb9e331c3f10c93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.288010:0:15366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d24cf9a/0xbcb9e331c3f10c93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.288036:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432891.288039:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432891.288041:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.288143:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432891.288870:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432891.288878:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10c9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.288890:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787432891.288893:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432891.288906:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10c9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.288917:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10c9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.288926:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10c9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.288932:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10c9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.288952:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432891.288997:0:15366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432891.289004:0:15366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10c9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.289013:0:15366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031400 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432891.289017:0:15366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10c9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.289026:0:15366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10c9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.289040:0:15366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10c9a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.289048:0:15366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10c9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.289068:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432891.289071:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432891.289073:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432891.291232:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432891.291244:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076e9fde1/0xbcb9e331c3f10ca1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.291259:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787432891.291263:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432891.291269:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076e9fde1/0xbcb9e331c3f10ca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.291281:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076e9fde1/0xbcb9e331c3f10ca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.291292:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076e9fde1/0xbcb9e331c3f10ca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.291310:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076e9fde1/0xbcb9e331c3f10ca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.291334:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432891.291419:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432891.291428:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076e9fde1/0xbcb9e331c3f10ca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.291438:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030c00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432891.291444:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076e9fde1/0xbcb9e331c3f10ca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.291453:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076e9fde1/0xbcb9e331c3f10ca1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.291471:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076e9fde1/0xbcb9e331c3f10ca1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.291478:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076e9fde1/0xbcb9e331c3f10ca1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432891.291502:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.291504:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432891.291507:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432891.291917:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432891.292058:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432891.292066:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10ca8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.292076:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787432891.292080:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432891.292084:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10ca8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.292094:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10ca8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.292103:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10ca8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.292110:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10ca8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.292179:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787432891.292959:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432891.292967:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030f0db4e/0xbcb9e331c3f10caf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.292984:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787432891.292987:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432891.292992:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030f0db4e/0xbcb9e331c3f10caf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.293001:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030f0db4e/0xbcb9e331c3f10caf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.293009:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030f0db4e/0xbcb9e331c3f10caf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.293017:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030f0db4e/0xbcb9e331c3f10caf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.293188:0:15366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432891.293196:0:15366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10ca8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.293205:0:15366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030000 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432891.293209:0:15366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10ca8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.293217:0:15366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10ca8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.293232:0:15366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10ca8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.293239:0:15366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10ca8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.293260:0:15366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432891.293264:0:15366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030f0db4e/0xbcb9e331c3f10caf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.293270:0:15366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031c00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432891.293273:0:15366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030f0db4e/0xbcb9e331c3f10caf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.293279:0:15366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030f0db4e/0xbcb9e331c3f10caf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.293302:0:15366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030f0db4e/0xbcb9e331c3f10caf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432891.293310:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432891.293312:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432891.293314:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432891.293352:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787432891.293358:0:15042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030f0db4e/0xbcb9e331c3f10caf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.293720:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432891.294131:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432891.294139:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10cb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.294149:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787432891.294153:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432891.294158:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10cb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.294181:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10cb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.294189:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10cb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.294197:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10cb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.294219:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787432891.294697:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432891.294705:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10cb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.294713:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030400 already unused, calling callback (ffffffffc1752230) 00010000:00010000:0.0:1787432891.294716:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10cb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.294724:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10cb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.294737:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10cb6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432891.294897:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432891.294904:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011a55979/0xbcb9e331c3f10cbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.294913:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787432891.294915:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432891.294920:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011a55979/0xbcb9e331c3f10cbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.294929:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011a55979/0xbcb9e331c3f10cbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.294937:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011a55979/0xbcb9e331c3f10cbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.294957:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011a55979/0xbcb9e331c3f10cbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.294969:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787432891.295384:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432891.295390:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1400419/0xbcb9e331c3f10cc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.295398:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787432891.295402:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432891.295406:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1400419/0xbcb9e331c3f10cc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.295415:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1400419/0xbcb9e331c3f10cc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.295422:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1400419/0xbcb9e331c3f10cc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.295429:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1400419/0xbcb9e331c3f10cc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432891.295444:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1787432891.295633:0:15042:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:0.0:1787432891.295838:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10cb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.295875:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787432891.295879:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011a55979/0xbcb9e331c3f10cbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.295886:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031000 already unused, calling callback (ffffffffc1752230) 00010000:00010000:0.0:1787432891.295891:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011a55979/0xbcb9e331c3f10cbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.295900:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011a55979/0xbcb9e331c3f10cbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.295915:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011a55979/0xbcb9e331c3f10cbd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.295923:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011a55979/0xbcb9e331c3f10cbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.295943:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432891.295946:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1400419/0xbcb9e331c3f10cc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.295952:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031e00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:0.0:1787432891.295955:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1400419/0xbcb9e331c3f10cc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.295975:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1400419/0xbcb9e331c3f10cc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.295988:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1400419/0xbcb9e331c3f10cc4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.295995:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1400419/0xbcb9e331c3f10cc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432891.296015:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432891.296017:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432891.296021:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432891.296032:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432891.296081:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14378:x1874258812831744:12345-0@lo:5:osp-pre-0-0.0 Request processed in 82206us (82549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432891.296109:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432891.296318:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14378:1874258812831744:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787432891.296334:0:14378:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1787432891.296382:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14378:1874258812831872:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787432891.296419:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432891.296463:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b989d5240 going to sleep for 11 seconds 00010000:00010000:0.0:1787432891.296892:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432891.297228:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812831872 00000100:00100000:3.0:1787432891.297236:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812831872 00000100:00100000:3.0:1787432891.297290:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432891.297300:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14378:x1874258812831872:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787432891.297350:0:15040:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1787432891.307159:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14378:x1874258812831872:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9851us (10730us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787432891.307174:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787432891.307276:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14378:1874258812831872:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787432891.307294:0:14378:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1787432891.511330:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787432891.929808:0:15408:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787432892.534851:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432893.558341:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787432894.405890:0:6749:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787432894.416878:0:6749:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:2.0:1787432894.582413:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432895.606218:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787432896.245865:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432896.245875:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787432896.245880:0:8:0:(import.c:65:import_set_state_nolock()) ffff935b857b1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787432896.245892:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 525 00000100:00080000:2.0:1787432896.245900:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787432896.245908:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff935b857b1800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:2.0:1787432896.245942:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff935bbaa52680 x1874258812832256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787432896.246028:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812832256:0@lo:8:kworker.0 00000100:00100000:2.0:1787432896.246125:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432896.246288:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d00b432-f54a-428d-8e42-8523236fbac8:3332:1874258812832000:0@lo:400:kworker.0 00000100:00100000:3.0:1787432896.246335:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432896.246377:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787432896.246384:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812832128:0@lo:400:kworker.0 00000100:00100000:3.0:1787432896.246417:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432896.246449:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3331:1874258812832512:0@lo:400:kworker.0 00000100:00100000:3.0:1787432896.246479:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432896.246503:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787432896.246509:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3331:1874258812832384:0@lo:400:kworker.0 00000100:00100000:3.0:1787432896.246531:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432896.246564:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812832256 00000100:00100000:3.0:1787432896.246573:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812832256 00000100:00100000:3.0:1787432896.246608:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812832128 00000100:00100000:3.0:1787432896.246611:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812832128 00000100:00100000:3.0:1787432896.246686:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432896.246697:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812832128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432896.246784:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812832128:12345-0@lo:400:kworker.0 Request processed in 88us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432896.246792:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787432896.246812:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787432896.246818:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3329:x1874258812832256:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787432896.246843:0:15042:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787432896.247812:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812832000 00000100:00100000:2.0:1787432896.247824:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812832000 00000100:00100000:2.0:1787432896.247874:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787432896.247882:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba418c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+16:3332:x1874258812832000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432896.247949:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba418c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+16:3332:x1874258812832000:12345-0@lo:400:kworker.0 Request processed in 68us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432896.247956:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787432896.254768:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812832512 00000100:00100000:2.0:1787432896.254788:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812832512 00000100:00100000:2.0:1787432896.254874:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812832384 00000100:00100000:2.0:1787432896.254878:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812832384 00000100:00100000:2.0:1787432896.254906:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787432896.254920:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3331:x1874258812832512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432896.255094:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3331:x1874258812832512:12345-0@lo:400:kworker.0 Request processed in 176us (8612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432896.255122:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787432896.255147:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787432896.255154:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3331:x1874258812832384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432896.255191:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3331:x1874258812832384:12345-0@lo:400:kworker.0 Request processed in 38us (8659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432896.255198:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787432896.255378:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bbaa51f80 x1874258812832384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432896.255397:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3331:1874258812832384:0@lo:400:kworker.0 00010000:00080000:2.0:1787432896.255413:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bbaa50e00 x1874258812832512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432896.255422:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3331:1874258812832512:0@lo:400:kworker.0 00000100:00080000:2.0:1787432896.257152:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787432896.257168:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432896.257810:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787432896.257843:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812832640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432896.257940:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432896.266776:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812832640 00000100:00100000:2.0:1787432896.266803:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812832640 00000100:00100000:2.0:1787432896.266887:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432896.266901:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812832640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432896.266961:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432896.267110:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812832640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 212us (9170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432896.267120:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432896.271590:0:3333:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787432896.271683:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812832640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432896.272008:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812832128:0@lo:400:kworker.0 00000100:00100000:3.0:1787432896.272023:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d00b432-f54a-428d-8e42-8523236fbac8:3332:1874258812832000:0@lo:400:kworker.0 00000100:00100000:3.0:1787432896.272865:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3329:x1874258812832256:12345-0@lo:8:kworker.0 Request processed in 26038us (26734us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787432896.272881:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787432896.272883:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935b857b1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787432896.272892:0:3329:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787432896.272917:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812832256:0@lo:8:kworker.0 00010000:00010000:0.0:1787432896.631941:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432897.660264:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787432898.487783:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787432898.677768:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432899.701848:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787432900.394580:0:15759:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787432900.394584:0:15759:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787432900.395053:0:15759:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff935bba8c7800 00000020:01000004:2.0:1787432900.395072:0:15759:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787432900.395088:0:15759:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787432900.395103:0:15759:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff935bbae799b8) 00000020:00000080:2.0:1787432900.395119:0:15759:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787432900.413884:0:15759:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787432900.414202:0:15759:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787432900.419176:0:15759:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787432900.419522:0:15759:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787432900.420288:0:15759:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787432900.420749:0:15759:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 175: rc = 0 00100000:10000000:3.0:1787432900.420923:0:15759:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 175: rc = 0 00100000:10000000:3.0:1787432900.421031:0:15759:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 175: rc = 0 00100000:10000000:3.0:1787432900.421570:0:15759:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 227: rc = 0 00100000:10000000:3.0:1787432900.422993:0:15759:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 227: rc = 0 00100000:10000000:3.0:1787432900.423245:0:15759:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 227: rc = 0 00100000:10000000:3.0:1787432900.423587:0:15759:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 227: rc = 0 00100000:10000000:3.0:1787432900.427523:0:15759:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 227: rc = 0 00100000:10000000:3.0:1787432900.427838:0:15759:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 227: rc = 0 00000020:00000080:3.0:1787432900.428433:0:15759:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787432900.428447:0:15759:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787432900.428459:0:15759:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbcb9e331c3f10cd2 00000020:01000004:3.0:1787432900.428468:0:15759:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787432900.428491:0:15759:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.115@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787432900.428495:0:15759:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787432900.428502:0:15759:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787432900.428524:0:15759:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787432900.428529:0:15759:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.115@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787432900.447848:0:15759:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787432900.447905:0:15759:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.115@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787432900.447910:0:15759:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787432900.447912:0:15759:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787432900.447913:0:15759:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432900.447914:0:15759:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432900.447916:0:15759:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432900.447917:0:15759:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432900.447919:0:15759:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787432900.447921:0:15759:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432900.447922:0:15759:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787432900.447926:0:15759:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787432900.447928:0:15759:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787432900.447929:0:15759:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787432900.447930:0:15759:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432900.447931:0:15759:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432900.447932:0:15759:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432900.447934:0:15759:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432900.447935:0:15759:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787432900.447936:0:15759:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432900.447937:0:15759:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787432900.447977:0:15759:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787432900.447998:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812832768:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787432900.448076:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432900.448188:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a8781a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787432900.453571:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812832768 00000100:00100000:3.0:1787432900.453588:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812832768 00000100:00100000:3.0:1787432900.453858:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787432900.453871:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba41ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+16:15759:x1874258812832768:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787432900.453938:0:14349:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787432900.453941:0:14349:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1787432900.453946:0:14349:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787432900.466962:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba41ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+16:15759:x1874258812832768:12345-0@lo:253:mount.lustre.0 Request processed in 13080us (18871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432900.466979:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787432900.467077:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812832768:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787432900.467109:0:15759:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787432900.467113:0:15759:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787432900.467115:0:15759:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787432900.467116:0:15759:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432900.467118:0:15759:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432900.467119:0:15759:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432900.467121:0:15759:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432900.467122:0:15759:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787432900.467125:0:15759:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432900.467127:0:15759:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787432900.467149:0:15759:0:(tgt_mount.c:101:server_register_mount()) register mount ffff935bba8c7800 from lustre-OST0001 10000000:01000000:2.0:1787432900.467178:0:15759:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787432900.467181:0:15759:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787432900.467189:0:15759:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff935b91a83370 local copy 00010000:00010000:2.0:1787432900.467201:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f10a78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10a7f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432900.467879:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812832896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432900.467927:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432900.468026:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff935a8781a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432900.468080:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812832896 00000100:00100000:0.0:1787432900.468088:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812832896 00000100:00100000:0.0:1787432900.468172:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787432900.468183:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba41a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+16:15759:x1874258812832896:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432900.468430:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba41a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+16:15759:x1874258812832896:12345-0@lo:501:mount.lustre.0 Request processed in 249us (502us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787432900.468437:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787432900.468638:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812832896:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787432900.468678:0:15759:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787432900.468843:0:15759:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787432900.468851:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f10a78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10a7f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432900.468862:0:15759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bc2154a00/0xbcb9e331c3f10a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10a7f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787432900.468901:0:15759:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff935bba8c7800 10000000:01000000:1.0:1787432900.468906:0:15759:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787432900.468911:0:15759:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787432900.468914:0:15759:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787432900.468919:0:15759:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787432900.468921:0:15759:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787432900.468948:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f10cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432900.468957:0:15759:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f10cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432900.468967:0:15759:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f10cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432900.468983:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812833024:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787432900.469016:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432900.469138:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba0720540 going to sleep for 11 seconds 00000100:00100000:2.0:1787432900.469235:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812833024 00000100:00100000:2.0:1787432900.469241:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812833024 00000100:00100000:2.0:1787432900.469270:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787432900.469279:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba418450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+16:15759:x1874258812833024:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432900.469290:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432900.469304:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bbaa5fa00/0xbcb9e331c3f10ce0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f10cd9 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432900.469473:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bbaa5fa00/0xbcb9e331c3f10ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f10cd9 expref: 17 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432900.469485:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bbaa5fa00/0xbcb9e331c3f10ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10cd9 expref: 17 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432900.469502:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5fa00, rc 0) 00000100:00100000:2.0:1787432900.469625:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba418450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+17:15759:x1874258812833024:12345-0@lo:101:mount.lustre.0 Request processed in 346us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432900.469633:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787432900.469818:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812833024:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432900.469833:0:15759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f10cd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10ce0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432900.469844:0:15759:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f10cd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f10ce0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787432900.470784:0:15759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787432900.472134:0:15759:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787432900.472742:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787432900.472798:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787432900.472834:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787432900.472882:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787432900.472919:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787432900.472953:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787432900.473022:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787432900.473031:0:15759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787432900.473130:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812833152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432900.473196:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432900.473234:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba0720c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787432900.473331:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812833152 00000100:00100000:0.0:1787432900.473338:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812833152 00000100:00100000:0.0:1787432900.473391:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787432900.473402:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba41b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+17:15759:x1874258812833152:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432900.473939:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba41b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+17:15759:x1874258812833152:12345-0@lo:501:mount.lustre.0 Request processed in 538us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432900.473947:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787432900.474711:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812833152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432900.474761:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812833280:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787432900.474818:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432900.474850:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba0793180 going to sleep for 11 seconds 00000100:00100000:1.0:1787432900.474913:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812833280 00000100:00100000:1.0:1787432900.474919:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812833280 00000100:00100000:1.0:1787432900.474952:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787432900.474960:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba41bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+17:15759:x1874258812833280:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432900.475694:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba41bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+17:15759:x1874258812833280:12345-0@lo:503:mount.lustre.0 Request processed in 732us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432900.475703:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787432900.475935:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812833280:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787432900.477266:0:15759:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787432900.477372:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812833408:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432900.477441:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432900.477548:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba0793180 going to sleep for 11 seconds 00000100:00100000:1.0:1787432900.477698:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812833408 00000100:00100000:1.0:1787432900.477706:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812833408 00000100:00100000:1.0:1787432900.477799:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787432900.477810:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba41b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+17:15759:x1874258812833408:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432900.478370:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba41b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+17:15759:x1874258812833408:12345-0@lo:502:mount.lustre.0 Request processed in 560us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432900.478378:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787432900.478477:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812833408:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787432900.478888:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787432900.478941:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787432900.478977:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787432900.479042:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787432900.479083:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787432900.479120:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787432900.479173:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787432900.479227:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787432900.479280:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787432900.479320:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812833536:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432900.479370:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432900.479425:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba0793180 going to sleep for 11 seconds 00000100:00100000:1.0:1787432900.479584:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812833536 00000100:00100000:1.0:1787432900.479598:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812833536 00000100:00100000:1.0:1787432900.479638:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787432900.479647:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+17:15759:x1874258812833536:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432900.479848:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+17:15759:x1874258812833536:12345-0@lo:502:mount.lustre.0 Request processed in 201us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432900.479856:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787432900.480266:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812833536:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787432900.480345:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787432900.480358:0:15759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1787432900.481575:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787432900.481584:0:15760:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787432900.481599:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787432900.481601:0:15760:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787432900.481608:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787432900.481633:0:15760:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff935a810b0000) 00000020:00000080:0.0:1787432900.481681:0:15760:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787432900.481690:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787432900.481759:0:15760:0:(tgt_mount.c:153:server_get_mount()) get mount ffff935bba8c7800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787432900.481767:0:15760:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787432900.481774:0:15760:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbcb9e331c3f10cee 00010000:00010000:1.0:1787432900.485827:0:15760:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1787432900.486240:0:15760:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1787432900.488439:0:15760:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787432900.489805:0:15760:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787432900.489817:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432900.489823:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432900.489826:0:15760:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787432900.489829:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432900.489833:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432900.489835:0:15760:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787432900.489838:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787432900.489840:0:15760:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787432900.489842:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432900.489845:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432900.489846:0:15760:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787432900.489848:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787432900.489850:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432900.489852:0:15760:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787432900.489855:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787432900.489900:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787432900.489903:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787432900.489905:0:15760:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787432900.489908:0:15760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787432900.490052:0:15759:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787432900.490082:0:15759:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787432900.490107:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f10cd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10ce0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432900.490119:0:15759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bba8e7a00/0xbcb9e331c3f10cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10ce0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432900.490129:0:15759:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff935bba8c7800 from 1 10000000:01000000:3.0:1787432900.490132:0:15759:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787432900.490166:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f10cf5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432900.490186:0:15759:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f10cf5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432900.490199:0:15759:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f10cf5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432900.490223:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812833664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787432900.490290:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432900.490327:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba0793f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432900.491744:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812833664 00000100:00100000:1.0:1787432900.491753:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812833664 00000100:00100000:1.0:1787432900.491804:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787432900.491814:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+17:15759:x1874258812833664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432900.491827:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432900.491851:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba8e6c00/0xbcb9e331c3f10cfc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f10cf5 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432900.491877:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba8e6c00/0xbcb9e331c3f10cfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f10cf5 expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432900.491890:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba8e6c00/0xbcb9e331c3f10cfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10cf5 expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432900.491899:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e6c00, rc 0) 00000100:00100000:1.0:1787432900.491962:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+18:15759:x1874258812833664:12345-0@lo:101:mount.lustre.0 Request processed in 149us (1671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432900.491969:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787432900.492330:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812833664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787432900.492349:0:15759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f10cf5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10cfc expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432900.492359:0:15759:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f10cf5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f10cfc expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787432900.493004:0:15759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787432900.493333:0:15759:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787432900.495307:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787432900.495397:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787432900.495480:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787432900.495489:0:15759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787432900.496530:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812833792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787432900.496710:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432900.496772:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba0793f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787432900.497096:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812833792 00000100:00100000:2.0:1787432900.497105:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812833792 00000100:00100000:2.0:1787432900.497166:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787432900.497178:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b95016c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+18:15759:x1874258812833792:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787432900.497440:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b95016c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+18:15759:x1874258812833792:12345-0@lo:501:mount.lustre.0 Request processed in 263us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432900.497448:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787432900.497705:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812833792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787432900.497759:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812833920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787432900.497804:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432900.497849:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b8676a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432900.497998:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812833920 00000100:00100000:3.0:1787432900.498004:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812833920 00000100:00100000:3.0:1787432900.498039:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787432900.498046:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b95016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+18:15759:x1874258812833920:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787432900.498211:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b95016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+18:15759:x1874258812833920:12345-0@lo:503:mount.lustre.0 Request processed in 164us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432900.498218:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787432900.498350:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812833920:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787432900.499213:0:15759:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787432900.499289:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812834048:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432900.499336:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432900.499361:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b8676a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432900.505265:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812834048 00000100:00100000:3.0:1787432900.505282:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812834048 00000100:00100000:3.0:1787432900.505353:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787432900.505364:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b95016050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+18:15759:x1874258812834048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432900.505698:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b95016050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+18:15759:x1874258812834048:12345-0@lo:502:mount.lustre.0 Request processed in 334us (6360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432900.505706:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787432900.505988:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812834048:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787432900.506342:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787432900.506402:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787432900.506452:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787432900.506489:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787432900.506864:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787432900.506922:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787432900.506960:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787432900.506997:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787432900.507856:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812834176:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432900.507940:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432900.507976:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b8676a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432900.509252:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812834176 00000100:00100000:3.0:1787432900.509265:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812834176 00000100:00100000:3.0:1787432900.509326:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787432900.509336:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b95016450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+18:15759:x1874258812834176:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787432900.509937:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b95016450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+18:15759:x1874258812834176:12345-0@lo:502:mount.lustre.0 Request processed in 601us (1995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432900.509947:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787432900.522295:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812834176:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787432900.527209:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787432900.527243:0:15759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787432900.533347:0:15764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432900.533366:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432900.533369:0:15764:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787432900.533376:0:15764:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff935bba8c7800 00000020:00000080:3.0:1787432900.533378:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787432900.533386:0:15764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432900.533388:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432900.533394:0:15764:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787432900.533398:0:15764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432900.533400:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432900.533402:0:15764:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787432900.533405:0:15764:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff935bba8c7800 00000020:00000080:3.0:1787432900.533407:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787432900.533474:0:15764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432900.533477:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432900.533479:0:15764:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787432900.533481:0:15764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787432900.533484:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432900.533485:0:15764:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787432900.533488:0:15764:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff935bba8c7800 00000020:00000080:3.0:1787432900.533491:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787432900.536173:0:15764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787432900.536185:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787432900.536187:0:15764:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787432900.536191:0:15764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787432900.537779:0:15759:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787432900.537825:0:15759:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787432900.537851:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f10cf5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10cfc expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.537867:0:15759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f10cf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10cfc expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432900.537932:0:15759:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787432900.537935:0:15759:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff935bba8c7800 10000000:01000000:0.0:1787432900.537939:0:15759:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff935bba8c7800 10000000:01000000:0.0:1787432900.537951:0:15759:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787432900.537957:0:15759:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff935bba8c7800 from 1 10000000:01000000:0.0:1787432900.537960:0:15759:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787432900.537999:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba1cfa00/0xbcb9e331c3f10d03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.538009:0:15759:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bba1cfa00/0xbcb9e331c3f10d03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.538021:0:15759:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bba1cfa00/0xbcb9e331c3f10d03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432900.538051:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812834304:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787432900.538144:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432900.538185:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b8676acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432900.550031:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812834304 00000100:00100000:2.0:1787432900.550044:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812834304 00000100:00100000:2.0:1787432900.550119:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787432900.550130:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b95017c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+18:15759:x1874258812834304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787432900.550147:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432900.550167:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bbaa5e800/0xbcb9e331c3f10d0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f10d03 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432900.550197:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bbaa5e800/0xbcb9e331c3f10d0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f10d03 expref: 19 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432900.550208:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bbaa5e800/0xbcb9e331c3f10d0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10d03 expref: 19 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432900.550228:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e800, rc 0) 00000100:00100000:2.0:1787432900.570808:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b95017c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+19:15759:x1874258812834304:12345-0@lo:101:mount.lustre.0 Request processed in 20670us (32653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432900.570822:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787432900.571822:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812834304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787432900.571852:0:15759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bba1cfa00/0xbcb9e331c3f10d03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10d0a expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432900.571865:0:15759:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bba1cfa00/0xbcb9e331c3f10d03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f10d0a expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787432900.572518:0:15759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787432900.572878:0:15759:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787432900.573171:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787432900.573216:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787432900.573249:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787432900.573294:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787432900.573332:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787432900.573380:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787432900.573418:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787432900.573453:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787432900.573514:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787432900.573552:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787432900.573585:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787432900.573649:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787432900.573741:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787432900.573778:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787432900.573825:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787432900.573859:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787432900.573892:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787432900.573943:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787432900.573981:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787432900.574018:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787432900.574067:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787432900.574105:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787432900.574141:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787432900.574189:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787432900.574224:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787432900.574257:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787432900.574304:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787432900.574341:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787432900.574394:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787432900.574448:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1787432900.574481:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1787432900.574511:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1787432900.574545:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1787432900.587841:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1787432900.587967:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1787432900.588069:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1787432900.588123:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1787432900.588224:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1787432900.588232:0:15759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787432900.588397:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812834432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432900.588480:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432900.588526:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812834432 00000100:00100000:1.0:1787432900.588533:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812834432 00000100:00100000:1.0:1787432900.588578:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787432900.588588:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+19:15759:x1874258812834432:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432900.588850:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+19:15759:x1874258812834432:12345-0@lo:501:mount.lustre.0 Request processed in 262us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432900.588858:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787432900.588902:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9149e000 going to sleep for 11 seconds 00000100:00100000:1.0:1787432900.588922:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812834432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787432900.588951:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812834560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432900.588991:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432900.589013:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812834560 00000100:00100000:1.0:1787432900.589017:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812834560 00000100:00100000:1.0:1787432900.589038:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787432900.589045:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+19:15759:x1874258812834560:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787432900.589177:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+19:15759:x1874258812834560:12345-0@lo:503:mount.lustre.0 Request processed in 132us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432900.589184:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787432900.589217:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b9149e000 going to sleep for 11 seconds 00000100:00100000:1.0:1787432900.589230:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812834560:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787432900.589792:0:15759:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787432900.589859:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812834688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432900.589905:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432900.589936:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812834688 00000100:00100000:1.0:1787432900.589947:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812834688 00000100:00100000:1.0:1787432900.589977:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787432900.589984:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+19:15759:x1874258812834688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432900.590153:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+19:15759:x1874258812834688:12345-0@lo:502:mount.lustre.0 Request processed in 169us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432900.590160:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787432900.590204:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b98ae00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432900.590218:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812834688:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787432900.590429:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787432900.590472:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787432900.590504:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787432900.590582:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787432900.598773:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787432900.598866:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787432900.598904:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787432900.598942:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787432900.598994:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787432900.599034:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787432900.599075:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787432900.599142:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787432900.599180:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787432900.599216:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787432900.599269:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787432900.599642:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787432900.599865:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787432900.599925:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787432900.599964:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787432900.600031:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787432900.600186:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787432900.600229:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787432900.600281:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787432900.600399:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787432900.600438:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787432900.600473:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787432900.600519:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787432900.600556:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787432900.600602:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787432900.602237:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787432900.603238:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787432900.603294:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787432900.603472:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787432900.603551:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787432900.603600:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787432900.604268:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787432900.604741:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787432900.604788:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787432900.604841:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787432900.604877:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787432900.604932:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812834816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787432900.605022:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432900.605457:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b98ae00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432900.615090:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812834816 00000100:00100000:0.0:1787432900.615108:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812834816 00000100:00100000:0.0:1787432900.615167:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787432900.615178:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+19:15759:x1874258812834816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787432900.615486:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+19:15759:x1874258812834816:12345-0@lo:502:mount.lustre.0 Request processed in 310us (10463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432900.615495:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787432900.620248:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812834816:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787432900.620426:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787432900.620444:0:15759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787432900.622418:0:15769:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787432900.622436:0:15769:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff935b906299b8) 00000020:00000080:3.0:1787432900.622459:0:15769:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1787432900.622528:0:15769:0:(tgt_mount.c:153:server_get_mount()) get mount ffff935bba8c7800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787432900.622532:0:15769:0:(tgt_mount.c:187:server_put_mount()) put mount ffff935bba8c7800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787432900.622535:0:15769:0:(obd_mount.c:710:lustre_put_lsi()) put ffff935bba8c7800 3 00010000:00080000:3.0:1787432900.622565:0:15769:0:(ldlm_lib.c:102:import_set_conn()) imp ffff935bba8c5800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.115@tcp at head 00010000:00010000:0.0:1787432900.633998:0:15769:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1787432900.639415:0:15769:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787432900.639463:0:15769:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787432900.639483:0:15769:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbcb9e331c3f10d18 00000100:00080000:0.0:1787432900.639495:0:15769:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787432900.639500:0:15769:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff935bba8c5800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:0.0:1787432900.639539:0:15769:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff935bbad2a300 x1874258812834944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787432900.639607:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3329:1874258812834944:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787432900.639698:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432900.639785:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812834944 00000100:00100000:1.0:1787432900.639792:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812834944 00000100:00100000:1.0:1787432900.639823:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787432900.639830:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3329:x1874258812834944:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787432900.639850:0:14355:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:1.0:1787432900.639894:0:14355:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbcb9e331c3f10d1f 00000004:00100000:1.0:1787432900.639907:0:14355:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787432900.639934:0:14355:0:(import.c:65:import_set_state_nolock()) ffff935b913fc000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1787432900.641401:0:15769:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1787432900.647247:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:2.0:1787432900.651397:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787432900.651404:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787432900.651409:0:8:0:(import.c:65:import_set_state_nolock()) ffff935b857b1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787432900.651417:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 530 00000100:00080000:2.0:1787432900.651422:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787432900.651429:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff935b857b1800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:2.0:1787432900.651453:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff935bbaa51f80 x1874258812835200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000000:2.0:1787432900.651555:0:15759:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787432900.651605:0:15759:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787432900.651626:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba1cfa00/0xbcb9e331c3f10d03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10d0a expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432900.651636:0:15759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bba1cfa00/0xbcb9e331c3f10d03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10d0a expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787432900.651739:0:15759:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787432900.651741:0:15759:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787432900.651742:0:15759:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432900.651744:0:15759:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432900.651745:0:15759:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432900.651746:0:15759:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432900.651748:0:15759:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787432900.651750:0:15759:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432900.651755:0:15759:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787432900.651759:0:15759:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787432900.651761:0:15759:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787432900.651762:0:15759:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787432900.651763:0:15759:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432900.651764:0:15759:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432900.651765:0:15759:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432900.651766:0:15759:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432900.651767:0:15759:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787432900.651768:0:15759:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432900.651768:0:15759:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787432900.651784:0:15759:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787432900.651799:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812835584:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787432900.651884:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432900.651924:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91fa3300 going to sleep for 11 seconds 00000100:00100000:2.0:1787432900.651944:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3331:1874258812835456:0@lo:400:kworker.0 00000100:00100000:2.0:1787432900.651975:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432900.652003:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432900.652008:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3331:1874258812835328:0@lo:400:kworker.0 00000100:00100000:2.0:1787432900.652029:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432900.652069:0:14356:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787432900.652076:0:14356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787432900.653246:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787432900.653269:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812835072:0@lo:400:kworker.0 00000100:00100000:2.0:1787432900.653339:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432900.653388:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812835072 00000100:00100000:2.0:1787432900.653395:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812835072 00000100:00100000:2.0:1787432900.653461:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432900.653473:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812835072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432900.653538:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812835072:12345-0@lo:400:kworker.0 Request processed in 68us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432900.653564:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787432900.653599:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787432900.653651:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812835072:0@lo:400:kworker.0 00000100:00100000:0.0:1787432900.654012:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787432900.654026:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812835456 00000100:00100000:0.0:1787432900.654031:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812835456 00000100:00100000:0.0:1787432900.654075:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787432900.654090:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812835328 00000100:00100000:0.0:1787432900.654093:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812835328 00000100:00100000:0.0:1787432900.654106:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787432900.654114:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787432900.654120:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3331:x1874258812835456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432900.654170:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3331:x1874258812835456:12345-0@lo:400:kworker.0 Request processed in 50us (2194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432900.654177:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787432900.654187:0:14357:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787432900.654193:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787432900.654198:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3331:x1874258812835328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432900.654220:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3331:x1874258812835328:12345-0@lo:400:kworker.0 Request processed in 23us (2191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432900.654225:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787432900.654599:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bbaa52d80 x1874258812835328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432900.654612:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3331:1874258812835328:0@lo:400:kworker.0 00010000:00080000:0.0:1787432900.654638:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bbaa50700 x1874258812835456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432900.654646:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3331:1874258812835456:0@lo:400:kworker.0 00000100:00100000:1.0:1787432900.655148:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3329:x1874258812834944:12345-0@lo:38:llog_process_th.0 Request processed in 15314us (15446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432900.655164:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787432900.655213:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812835584 00000100:00100000:1.0:1787432900.655219:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812835584 00000100:00100000:1.0:1787432900.655259:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787432900.655267:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+19:15759:x1874258812835584:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787432900.655297:0:14349:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787432900.655538:0:14349:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:2.0:1787432900.657629:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787432900.657830:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff935bbad2a300 x1874258812834944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787432910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787432900.657845:0:3329:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787432900.657855:0:3329:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787432900.657877:0:3329:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787432900.657882:0:3329:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787432900.657886:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935bba8c5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787432900.657894:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3329:1874258812834944:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787432900.657927:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812835200:0@lo:8:kworker.0 00000100:00100000:3.0:1787432900.657997:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432900.658112:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812835200 00000100:00100000:2.0:1787432900.658118:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812835200 00000100:00100000:2.0:1787432900.658162:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787432900.658171:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3329:x1874258812835200:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787432900.658229:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3329:x1874258812835200:12345-0@lo:8:kworker.0 Request processed in 58us (231us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787432900.658235:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787432900.663209:0:3329:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787432900.663225:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935b857b1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787432900.663232:0:3329:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787432900.663237:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812835200:0@lo:8:kworker.0 20000000:01000000:0.0:1787432900.717834:0:14349:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787432900.717854:0:14349:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787432900.718269:0:14371:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787432900.718275:0:14371:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787432900.718298:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff935b80031200/0xbcb9e331c3f10d26 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432900.718317:0:14371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bba1cfe00/0xbcb9e331c3f10bf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10bf2 expref: 19 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432900.718326:0:14371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff935b80031200/0xbcb9e331c3f10d26 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432900.718366:0:14371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bba1cfe00/0xbcb9e331c3f10bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f10bf2 expref: 19 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432900.718380:0:14371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff935bba1cfe00/0xbcb9e331c3f10bf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f10bf2 expref: 19 pid: 14350 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432900.718395:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad11500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14371:1874258812835712:0@lo:104: 00000100:00100000:3.0:1787432900.718474:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432900.718528:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b875ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432900.718828:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812835712 00000100:00100000:0.0:1787432900.718836:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812835712 00000100:00100000:0.0:1787432900.718883:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432900.718892:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d00b432-f54a-428d-8e42-8523236fbac8+3:14371:x1874258812835712:12345-0@lo:104: 00010000:00010000:0.0:1787432900.718906:0:14338:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fc00/0xbcb9e331c3f10bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f10bf9 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.718960:0:14338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787432900.718966:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d00b432-f54a-428d-8e42-8523236fbac8+3:14371:x1874258812835712:12345-0@lo:104: Request processed in 75us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432900.718974:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787432900.718997:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432900.719003:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fc00/0xbcb9e331c3f10bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f10bf9 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.719010:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fc00 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:0.0:1787432900.719014:0:14343:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fc00/0xbcb9e331c3f10bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f10bf9 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.719023:0:14343:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fc00/0xbcb9e331c3f10bf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f10bf9 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432900.719030:0:14343:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fc00/0xbcb9e331c3f10bf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f10bf9 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432900.719044:0:14343:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787432900.719075:0:14343:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fc00/0xbcb9e331c3f10bf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10bf9 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.719082:0:14343:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432900.719102:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fc00/0xbcb9e331c3f10bf2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10bf9 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.719110:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bbaa5fc00/0xbcb9e331c3f10bf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10bf9 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.719130:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432900.719132:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432900.719198:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432900.719213:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787432900.719225:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d00b432-f54a-428d-8e42-8523236fbac8:3333:1874258812835840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432900.719327:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432900.719366:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812835840 00000100:00100000:0.0:1787432900.719370:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812835840 00010000:00010000:0.0:1787432900.719391:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bba1cfe00/0xbcb9e331c3f10bf9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f10bf2 expref: 20 pid: 14350 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432900.719415:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432900.719421:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d00b432-f54a-428d-8e42-8523236fbac8+20:3333:x1874258812835840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432900.719433:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432900.719438:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bba1cfe00/0xbcb9e331c3f10bf9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f10bf2 expref: 20 pid: 14350 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.719449:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bba1cfe00/0xbcb9e331c3f10bf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f10bf2 expref: 20 pid: 14350 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.719488:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff935b80031200/0xbcb9e331c3f10d26 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.719496:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935b80031200/0xbcb9e331c3f10d26 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787432900.719651:0:14340:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002554850s 00010000:00010000:0.0:1787432900.719704:0:14340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935b80031200/0xbcb9e331c3f10d26 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.719713:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935b80031200/0xbcb9e331c3f10d26 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.719721:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff935b80031200/0xbcb9e331c3f10d26 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.719728:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff935b80031200/0xbcb9e331c3f10d26 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.719733:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031200 already unused, calling callback (ffffffffc1752230) 00010000:00010000:0.0:1787432900.719737:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff935b80031200/0xbcb9e331c3f10d26 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.719744:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff935b80031200/0xbcb9e331c3f10d26 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.719753:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff935b80031200/0xbcb9e331c3f10d26 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.719763:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432900.719795:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d00b432-f54a-428d-8e42-8523236fbac8+20:3333:x1874258812835840:12345-0@lo:103:ldlm_bl.0 Request processed in 373us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432900.719808:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787432900.719850:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d00b432-f54a-428d-8e42-8523236fbac8:3333:1874258812835840:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432900.719895:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bba1cfe00/0xbcb9e331c3f10bf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f10bf2 expref: 19 pid: 14350 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432900.719905:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad11500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14371:1874258812835712:0@lo:104: 00010000:00010000:0.0:1787432900.719918:0:14371:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff935b80031200/0xbcb9e331c3f10d26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.719927:0:14371:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff935b80031200/0xbcb9e331c3f10d26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.719933:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff935b80031200/0xbcb9e331c3f10d26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432900.719940:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935b80031200/0xbcb9e331c3f10d26 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432900.726019:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432900.731086:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+18:15759:x1874258812835584:12345-0@lo:253:mount.lustre.0 Request processed in 75810us (79193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432900.731102:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787432900.731245:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d00b432-f54a-428d-8e42-8523236fbac8:15759:1874258812835584:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787432900.731336:0:15759:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787432900.731340:0:15759:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787432900.731342:0:15759:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787432900.731344:0:15759:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787432900.731345:0:15759:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787432900.731346:0:15759:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787432900.731348:0:15759:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787432900.731349:0:15759:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787432900.731352:0:15759:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787432900.731353:0:15759:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787432900.731369:0:15759:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787432900.737527:0:15759:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787432900.737910:0:15759:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787432900.738064:0:15759:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787432900.738301:0:15759:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787432900.738531:0:15759:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787432900.738922:0:15759:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787432900.740900:0:15759:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787432900.827792:0:15759:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787432900.827805:0:15759:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787432900.827844:0:15759:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787432900.827902:0:15759:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.115@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787432900.827922:0:15759:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787432900.827953:0:15759:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:0.0:1787432901.371472:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812835968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432901.371545:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432901.375483:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812835968 00000100:00100000:1.0:1787432901.375504:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812835968 00000100:00100000:1.0:1787432901.375601:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787432901.375612:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812835968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432901.390456:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432901.390599:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812835968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 14985us (19049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432901.390611:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787432901.390768:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812835968:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787432901.750836:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787432902.215236:0:14353:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787432902.215246:0:14353:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff935bbb47d000 from 8 10000000:01000000:1.0:1787432902.215251:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787432902.215305:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba8e6800/0xbcb9e331c3f10d2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432902.215317:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bba8e6800/0xbcb9e331c3f10d2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432902.215330:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bba8e6800/0xbcb9e331c3f10d2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432902.215377:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812836096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787432902.215451:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432902.215712:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87c5d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787432902.222064:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812836096 00000100:00100000:0.0:1787432902.222081:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812836096 00000100:00100000:1.0:1787432902.224141:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787432902.224156:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+18:14353:x1874258812836096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432902.224174:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432902.224193:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba8e7400/0xbcb9e331c3f10d34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f10d2d expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432902.224220:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba8e7400/0xbcb9e331c3f10d34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f10d2d expref: 19 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432902.224232:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba8e7400/0xbcb9e331c3f10d34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10d2d expref: 19 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432902.224242:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e7400, rc 0) 00000100:00100000:1.0:1787432902.224317:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+19:14353:x1874258812836096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (8866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432902.224325:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787432902.227902:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812836096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432902.227931:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bba8e6800/0xbcb9e331c3f10d2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10d34 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432902.227943:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bba8e6800/0xbcb9e331c3f10d2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f10d34 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432902.228047:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812836224:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787432902.228110:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432902.228164:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87c5d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787432902.231644:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812836224 00000100:00100000:1.0:1787432902.231673:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812836224 00000100:00100000:1.0:1787432902.231734:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787432902.231746:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+19:14353:x1874258812836224:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787432902.231772:0:14350:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787432902.231794:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787432902.231798:0:14350:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787432902.231927:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+19:14353:x1874258812836224:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 183us (3816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432902.231934:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787432902.231992:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812836224:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787432902.232053:0:14353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787432902.232063:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba8e6800/0xbcb9e331c3f10d2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10d34 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432902.232073:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bba8e6800/0xbcb9e331c3f10d2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10d34 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432902.780793:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432903.802750:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432904.823693:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432905.848586:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432905.979929:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d00b432-f54a-428d-8e42-8523236fbac8:3330:1874258812836352:0@lo:400:kworker.0 00000100:00100000:2.0:1787432905.980023:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432905.992908:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432905.992934:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812836480:0@lo:400:kworker.0 00000100:00100000:2.0:1787432905.993020:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432905.993096:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812836352 00000100:00100000:2.0:1787432905.993105:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812836352 00000100:00100000:2.0:1787432905.993155:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787432905.993164:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+19:3330:x1874258812836352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432905.993234:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+19:3330:x1874258812836352:12345-0@lo:400:kworker.0 Request processed in 70us (13210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432905.993242:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787432905.993365:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812836480 00000100:00100000:2.0:1787432905.993370:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812836480 00000100:00100000:2.0:1787432905.993408:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787432905.993415:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812836480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432905.993448:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812836480:12345-0@lo:400:kworker.0 Request processed in 34us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432905.993469:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787432905.993508:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812836480:0@lo:400:kworker.0 00000100:00100000:2.0:1787432905.993518:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d00b432-f54a-428d-8e42-8523236fbac8:3330:1874258812836352:0@lo:400:kworker.0 00000100:00080000:2.0:1787432905.993549:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787432905.995954:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787432905.995965:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787432905.995968:0:8:0:(import.c:65:import_set_state_nolock()) ffff935b857b1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787432905.995980:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff935b857b1800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:2.0:1787432905.996195:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff935bbaa50e00 x1874258812836608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787432905.996267:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812836736:0@lo:400:kworker.0 00000100:00100000:2.0:1787432905.996332:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432905.996390:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812836736 00000100:00100000:2.0:1787432905.996397:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812836736 00000100:00100000:2.0:1787432905.996442:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432905.996452:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812836736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432905.996683:0:3329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812836608:0@lo:8:kworker.0 00000100:00100000:3.0:1787432905.996716:0:3329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432905.996750:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812836608 00000100:00100000:3.0:1787432905.996754:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812836608 00000100:00100000:3.0:1787432905.996776:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787432905.996781:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3329:x1874258812836608:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787432905.996822:0:15041:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:3.0:1787432905.996849:0:15041:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbcb9e331c3f10d3b 00002000:00100000:3.0:1787432905.996864:0:15041:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff935bbb682800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211393f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787432905.996869:0:15041:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787432905.996871:0:15041:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787432905.997200:0:15041:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787432905.997294:0:15041:0:(import.c:65:import_set_state_nolock()) ffff935bbb681000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787432905.997344:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3329:x1874258812836608:12345-0@lo:8:kworker.0 Request processed in 561us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432905.997352:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787432905.997395:0:3329:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa50e00 x1874258812836608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787432930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787432905.997409:0:3329:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787432905.997417:0:3329:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787432905.997421:0:3329:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787432905.997423:0:3329:0:(import.c:65:import_set_state_nolock()) ffff935b857b1800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787432905.997435:0:3329:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787432905.997440:0:3329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3329:1874258812836608:0@lo:8:kworker.0 00000004:00080000:3.0:1787432905.997565:0:14380:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1787432905.997583:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad10e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14380:1874258812836992:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787432905.997609:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432905.997625:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b8676a780 going to sleep for 11 seconds 00000004:00080000:3.0:1787432905.997640:0:14379:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787432905.997969:0:14379:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 540663310619ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787432905.997993:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812836864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432905.998031:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432905.998070:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812836992 00000100:00100000:3.0:1787432905.998075:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812836992 00000100:00100000:3.0:1787432905.998110:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432905.998118:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14380:x1874258812836992:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787432905.998357:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812836736:12345-0@lo:400:kworker.0 Request processed in 1906us (2024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432905.998370:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432905.998422:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812837120:0@lo:400:kworker.0 00000100:00100000:2.0:1787432905.998448:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432905.998514:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812837248:0@lo:400:kworker.0 00000100:00100000:2.0:1787432905.998552:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432905.998581:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812837120 00000100:00100000:2.0:1787432905.998585:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812837120 00000100:00100000:2.0:1787432905.998608:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812837248 00000100:00100000:2.0:1787432905.998611:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812837248 00000100:00100000:2.0:1787432905.998629:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787432905.998636:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812837120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432905.998684:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812837120:12345-0@lo:400:kworker.0 Request processed in 49us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432905.998691:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787432905.998702:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787432905.998707:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812837248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432905.998735:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812837248:12345-0@lo:400:kworker.0 Request processed in 28us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432905.998741:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787432905.998769:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa50e00 x1874258812837120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432905.998780:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812837120:0@lo:400:kworker.0 00010000:00080000:2.0:1787432905.998801:0:3331:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa50700 x1874258812837248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432905.998808:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812837248:0@lo:400:kworker.0 00000100:00080000:2.0:1787432905.998853:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787432905.998857:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432905.998869:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812836864 00000100:00100000:2.0:1787432905.998872:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812836864 00000100:00100000:2.0:1787432905.998892:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787432905.998897:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3333:x1874258812836864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432905.998919:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432905.998956:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3333:x1874258812836864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432905.998962:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787432905.999013:0:3332:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbaa51180 x1874258812836736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432905.999023:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812836736:0@lo:400:kworker.0 00010000:00080000:2.0:1787432905.999057:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bbad12680 x1874258812836864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787432921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432905.999070:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812836864:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1787432906.017391:0:15042:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787432906.017405:0:15042:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787432906.017411:0:15042:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1787432906.039176:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.039189:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a1e87af/0xbcb9e331c3f10d42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.039208:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.039213:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.039219:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a1e87af/0xbcb9e331c3f10d42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.039237:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a1e87af/0xbcb9e331c3f10d42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.039247:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a1e87af/0xbcb9e331c3f10d42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.039255:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a1e87af/0xbcb9e331c3f10d42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.039278:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787432906.039784:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.039791:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0743d10/0xbcb9e331c3f10d49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.039800:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.039803:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.039807:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0743d10/0xbcb9e331c3f10d49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.039815:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0743d10/0xbcb9e331c3f10d49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.039823:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0743d10/0xbcb9e331c3f10d49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.039831:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0743d10/0xbcb9e331c3f10d49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.039847:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787432906.040219:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.040225:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc1302b8/0xbcb9e331c3f10d50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.040234:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.040237:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.040241:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc1302b8/0xbcb9e331c3f10d50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.040262:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc1302b8/0xbcb9e331c3f10d50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.040270:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc1302b8/0xbcb9e331c3f10d50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.040277:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc1302b8/0xbcb9e331c3f10d50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.040291:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787432906.041133:0:15366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787432906.041141:0:15366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a1e87af/0xbcb9e331c3f10d42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.041163:0:15366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031a00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432906.041167:0:15366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a1e87af/0xbcb9e331c3f10d42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.041176:0:15366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a1e87af/0xbcb9e331c3f10d42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.041197:0:15366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a1e87af/0xbcb9e331c3f10d42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.041580:0:15366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a1e87af/0xbcb9e331c3f10d42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.041604:0:15366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432906.041608:0:15366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0743d10/0xbcb9e331c3f10d49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.041614:0:15366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031800 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432906.041618:0:15366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0743d10/0xbcb9e331c3f10d49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.041626:0:15366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0743d10/0xbcb9e331c3f10d49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.041636:0:15366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0743d10/0xbcb9e331c3f10d49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.041650:0:15366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0743d10/0xbcb9e331c3f10d49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.041681:0:15366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432906.041685:0:15366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc1302b8/0xbcb9e331c3f10d50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.041691:0:15366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031200 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432906.041695:0:15366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc1302b8/0xbcb9e331c3f10d50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.041702:0:15366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc1302b8/0xbcb9e331c3f10d50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.041713:0:15366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc1302b8/0xbcb9e331c3f10d50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.041719:0:15366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc1302b8/0xbcb9e331c3f10d50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.041731:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432906.041733:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432906.041735:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432906.042181:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432906.042714:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432906.047893:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.047980:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f10d57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.048000:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.048006:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.048014:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f10d57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.048031:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f10d57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.048042:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f10d57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.048059:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f10d57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.048078:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787432906.050797:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.050811:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a55979/0xbcb9e331c3f10d5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.050831:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.050835:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.050841:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a55979/0xbcb9e331c3f10d5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.050856:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011a55979/0xbcb9e331c3f10d5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.050867:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a55979/0xbcb9e331c3f10d5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.050875:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011a55979/0xbcb9e331c3f10d5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.050897:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787432906.055843:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.055857:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10d65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.055883:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.055888:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.055894:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10d65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.055919:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10d65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.055929:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10d65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.055937:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10d65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.055958:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787432906.056449:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.056467:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076e9fde1/0xbcb9e331c3f10d6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.056476:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.056480:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.056484:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076e9fde1/0xbcb9e331c3f10d6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.056494:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076e9fde1/0xbcb9e331c3f10d6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.056511:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076e9fde1/0xbcb9e331c3f10d6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.056517:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076e9fde1/0xbcb9e331c3f10d6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.056524:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787432906.056948:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.056954:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10d73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.056963:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.056966:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.056970:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10d73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.056979:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10d73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.056986:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10d73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.056993:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10d73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.057011:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1787432906.057422:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.057428:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f10d7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.057437:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.057440:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.057444:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f10d7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.057453:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f10d7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.057461:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f10d7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.057468:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f10d7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.057475:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1787432906.058631:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787432906.058643:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f10d57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058682:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031e00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432906.058687:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f10d57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058697:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f10d57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058718:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f10d57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058726:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f10d57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058750:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787432906.058754:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011a55979/0xbcb9e331c3f10d5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058760:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031000 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432906.058763:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a55979/0xbcb9e331c3f10d5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058771:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a55979/0xbcb9e331c3f10d5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058781:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011a55979/0xbcb9e331c3f10d5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058794:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011a55979/0xbcb9e331c3f10d5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058808:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787432906.058812:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10d65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058820:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030400 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432906.058823:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10d65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058831:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10d65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058842:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10d65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058849:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb83cb58/0xbcb9e331c3f10d65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058861:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787432906.058865:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076e9fde1/0xbcb9e331c3f10d6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058872:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030c00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432906.058882:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076e9fde1/0xbcb9e331c3f10d6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058890:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076e9fde1/0xbcb9e331c3f10d6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058900:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076e9fde1/0xbcb9e331c3f10d6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058908:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076e9fde1/0xbcb9e331c3f10d6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058921:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432906.058925:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10d73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058931:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030000 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432906.058934:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10d73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058942:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10d73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058951:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10d73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058958:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10d73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058977:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432906.058981:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f10d7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058987:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030200 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432906.058990:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f10d7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.058998:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f10d7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.059009:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f10d7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.059016:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f10d7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.059029:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432906.059031:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432906.059033:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432906.063727:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432906.063738:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432906.064838:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.064849:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10d81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.064869:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.064884:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.064893:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10d81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.065034:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10d81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.065047:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10d81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.065054:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10d81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.065782:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787432906.068532:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.068558:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d24cf9a/0xbcb9e331c3f10d88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.068576:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.068582:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.068589:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d24cf9a/0xbcb9e331c3f10d88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.068605:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d24cf9a/0xbcb9e331c3f10d88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.068617:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d24cf9a/0xbcb9e331c3f10d88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.068634:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d24cf9a/0xbcb9e331c3f10d88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.077631:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787432906.077650:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10d81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.077687:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031400 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432906.077694:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10d81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.077705:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10d81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.077727:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10d81 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.077734:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10d81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.077793:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432906.077798:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d24cf9a/0xbcb9e331c3f10d88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.077804:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030800 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432906.077806:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d24cf9a/0xbcb9e331c3f10d88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.077813:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d24cf9a/0xbcb9e331c3f10d88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.077822:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d24cf9a/0xbcb9e331c3f10d88 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.077834:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432906.077836:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432906.077838:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787432906.084601:0:5889:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1787432906.085346:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787432906.085359:0:15042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d24cf9a/0xbcb9e331c3f10d88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787432906.086436:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.086448:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005eebb678/0xbcb9e331c3f10d8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.086468:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.086474:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.086482:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005eebb678/0xbcb9e331c3f10d8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.086512:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005eebb678/0xbcb9e331c3f10d8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.086525:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005eebb678/0xbcb9e331c3f10d8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.086534:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005eebb678/0xbcb9e331c3f10d8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.086585:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787432906.087143:0:15366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432906.087152:0:15366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005eebb678/0xbcb9e331c3f10d8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.087162:0:15366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2166200 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432906.087168:0:15366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005eebb678/0xbcb9e331c3f10d8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.087179:0:15366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005eebb678/0xbcb9e331c3f10d8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.087199:0:15366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005eebb678/0xbcb9e331c3f10d8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.087220:0:15366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005eebb678/0xbcb9e331c3f10d8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432906.087240:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432906.087242:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432906.087244:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432906.087436:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432906.092371:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.092391:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001764bc95/0xbcb9e331c3f10d96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.092411:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.092416:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.092423:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001764bc95/0xbcb9e331c3f10d96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.092437:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001764bc95/0xbcb9e331c3f10d96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.092448:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001764bc95/0xbcb9e331c3f10d96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.092468:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001764bc95/0xbcb9e331c3f10d96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.092494:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787432906.093077:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.093084:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069a1ff78/0xbcb9e331c3f10d9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.093093:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.093102:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.093108:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069a1ff78/0xbcb9e331c3f10d9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.093119:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069a1ff78/0xbcb9e331c3f10d9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.093127:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069a1ff78/0xbcb9e331c3f10d9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.093135:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069a1ff78/0xbcb9e331c3f10d9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.093158:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787432906.093175:0:15366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787432906.093181:0:15366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001764bc95/0xbcb9e331c3f10d96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.093188:0:15366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2167e00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:3.0:1787432906.093193:0:15366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001764bc95/0xbcb9e331c3f10d96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.093202:0:15366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001764bc95/0xbcb9e331c3f10d96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.093218:0:15366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001764bc95/0xbcb9e331c3f10d96 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.093236:0:15366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001764bc95/0xbcb9e331c3f10d96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.093261:0:15366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432906.093265:0:15366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069a1ff78/0xbcb9e331c3f10d9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.093271:0:15366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2166c00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:3.0:1787432906.093274:0:15366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069a1ff78/0xbcb9e331c3f10d9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.093282:0:15366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069a1ff78/0xbcb9e331c3f10d9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.093291:0:15366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069a1ff78/0xbcb9e331c3f10d9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.093298:0:15366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069a1ff78/0xbcb9e331c3f10d9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.093309:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432906.093311:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432906.093313:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432906.093676:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432906.104776:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.104793:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a94ec73/0xbcb9e331c3f10da4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.104817:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.104821:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.104828:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a94ec73/0xbcb9e331c3f10da4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.104844:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a94ec73/0xbcb9e331c3f10da4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.104854:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a94ec73/0xbcb9e331c3f10da4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.104862:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a94ec73/0xbcb9e331c3f10da4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.104878:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787432906.105375:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.105382:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e6f6e79/0xbcb9e331c3f10dab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.105391:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.105395:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.105400:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e6f6e79/0xbcb9e331c3f10dab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.105410:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e6f6e79/0xbcb9e331c3f10dab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.105429:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e6f6e79/0xbcb9e331c3f10dab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.105436:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e6f6e79/0xbcb9e331c3f10dab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.105454:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787432906.105471:0:15366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787432906.105478:0:15366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a94ec73/0xbcb9e331c3f10da4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.105485:0:15366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2166800 already unused, calling callback (ffffffffc1752230) 00010000:00010000:3.0:1787432906.105490:0:15366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a94ec73/0xbcb9e331c3f10da4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.105499:0:15366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a94ec73/0xbcb9e331c3f10da4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.105517:0:15366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a94ec73/0xbcb9e331c3f10da4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.105524:0:15366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a94ec73/0xbcb9e331c3f10da4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.105553:0:15366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432906.105562:0:15366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e6f6e79/0xbcb9e331c3f10dab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.105570:0:15366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2167c00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:3.0:1787432906.105573:0:15366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e6f6e79/0xbcb9e331c3f10dab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.105581:0:15366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e6f6e79/0xbcb9e331c3f10dab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.105591:0:15366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e6f6e79/0xbcb9e331c3f10dab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.105599:0:15366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e6f6e79/0xbcb9e331c3f10dab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.105615:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432906.105617:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432906.105619:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432906.106043:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.106049:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c620040/0xbcb9e331c3f10db2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.106058:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.106061:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.106065:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c620040/0xbcb9e331c3f10db2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.106086:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c620040/0xbcb9e331c3f10db2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.106094:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c620040/0xbcb9e331c3f10db2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.106102:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c620040/0xbcb9e331c3f10db2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.106125:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787432906.106485:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.106491:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c23285c2/0xbcb9e331c3f10db9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.106499:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.106502:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.106506:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c23285c2/0xbcb9e331c3f10db9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.106515:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c23285c2/0xbcb9e331c3f10db9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.106523:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c23285c2/0xbcb9e331c3f10db9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.106551:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c23285c2/0xbcb9e331c3f10db9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.106566:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787432906.106577:0:15366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787432906.106582:0:15366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c620040/0xbcb9e331c3f10db2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.106588:0:15366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2166400 already unused, calling callback (ffffffffc1752230) 00010000:00010000:3.0:1787432906.106592:0:15366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c620040/0xbcb9e331c3f10db2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.106599:0:15366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c620040/0xbcb9e331c3f10db2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.106611:0:15366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c620040/0xbcb9e331c3f10db2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.106618:0:15366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c620040/0xbcb9e331c3f10db2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.106634:0:15366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432906.106638:0:15366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c23285c2/0xbcb9e331c3f10db9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.106681:0:15366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2167a00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:3.0:1787432906.106685:0:15366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c23285c2/0xbcb9e331c3f10db9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.106692:0:15366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c23285c2/0xbcb9e331c3f10db9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.106702:0:15366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c23285c2/0xbcb9e331c3f10db9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.106708:0:15366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c23285c2/0xbcb9e331c3f10db9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.106720:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432906.106721:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432906.106723:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432906.107104:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.107110:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006ef6c66/0xbcb9e331c3f10dc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.107117:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.107120:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.107124:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006ef6c66/0xbcb9e331c3f10dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.107133:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006ef6c66/0xbcb9e331c3f10dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.107148:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006ef6c66/0xbcb9e331c3f10dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.107154:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006ef6c66/0xbcb9e331c3f10dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.107167:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432906.107174:0:15366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432906.107178:0:15366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006ef6c66/0xbcb9e331c3f10dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.107184:0:15366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2167200 already unused, calling callback (ffffffffc1752230) 00010000:00010000:3.0:1787432906.107188:0:15366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006ef6c66/0xbcb9e331c3f10dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.107195:0:15366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006ef6c66/0xbcb9e331c3f10dc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.107205:0:15366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006ef6c66/0xbcb9e331c3f10dc0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.107212:0:15366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006ef6c66/0xbcb9e331c3f10dc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.107225:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432906.107232:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432906.107234:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432906.109164:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432906.113033:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432906.123823:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.123837:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069a1ff78/0xbcb9e331c3f10dc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.123854:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.123858:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.123864:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069a1ff78/0xbcb9e331c3f10dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.123878:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069a1ff78/0xbcb9e331c3f10dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.123889:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069a1ff78/0xbcb9e331c3f10dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.123896:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069a1ff78/0xbcb9e331c3f10dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.127355:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787432906.127379:0:15366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787432906.127387:0:15366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069a1ff78/0xbcb9e331c3f10dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.127398:0:15366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2166c00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:3.0:1787432906.127403:0:15366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069a1ff78/0xbcb9e331c3f10dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.127428:0:15366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069a1ff78/0xbcb9e331c3f10dc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.127451:0:15366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069a1ff78/0xbcb9e331c3f10dc7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.128003:0:15366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069a1ff78/0xbcb9e331c3f10dc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.128031:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432906.128033:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432906.128035:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432906.130751:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.130765:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001764bc95/0xbcb9e331c3f10dce lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.130783:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.130788:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.130796:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001764bc95/0xbcb9e331c3f10dce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.130810:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001764bc95/0xbcb9e331c3f10dce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.130824:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001764bc95/0xbcb9e331c3f10dce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.130844:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001764bc95/0xbcb9e331c3f10dce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.130868:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432906.131013:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432906.131021:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001764bc95/0xbcb9e331c3f10dce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.131030:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2167e00 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432906.131035:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001764bc95/0xbcb9e331c3f10dce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.131054:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001764bc95/0xbcb9e331c3f10dce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.131076:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001764bc95/0xbcb9e331c3f10dce lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.131084:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001764bc95/0xbcb9e331c3f10dce lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.131108:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432906.131110:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432906.131112:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432906.134711:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.134727:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3727226/0xbcb9e331c3f10dd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.134745:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.134750:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.134757:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3727226/0xbcb9e331c3f10dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.134774:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3727226/0xbcb9e331c3f10dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.134785:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3727226/0xbcb9e331c3f10dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.134793:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3727226/0xbcb9e331c3f10dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.134815:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432906.135449:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432906.135470:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3727226/0xbcb9e331c3f10dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.135481:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2167400 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432906.135487:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3727226/0xbcb9e331c3f10dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.135506:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3727226/0xbcb9e331c3f10dd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.135531:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3727226/0xbcb9e331c3f10dd5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.135566:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3727226/0xbcb9e331c3f10dd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.135594:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432906.135596:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432906.135598:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432906.140155:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.140168:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000429ac194/0xbcb9e331c3f10ddc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.140192:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.140197:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.140217:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000429ac194/0xbcb9e331c3f10ddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.140233:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000429ac194/0xbcb9e331c3f10ddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.140244:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000429ac194/0xbcb9e331c3f10ddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.140254:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000429ac194/0xbcb9e331c3f10ddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.140284:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432906.140418:0:15366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432906.140426:0:15366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000429ac194/0xbcb9e331c3f10ddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.140436:0:15366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2166000 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432906.140441:0:15366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000429ac194/0xbcb9e331c3f10ddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.140450:0:15366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000429ac194/0xbcb9e331c3f10ddc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.140484:0:15366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000429ac194/0xbcb9e331c3f10ddc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.140493:0:15366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000429ac194/0xbcb9e331c3f10ddc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.140517:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432906.140519:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432906.140521:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432906.141956:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.141966:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005eebb678/0xbcb9e331c3f10de3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.141979:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.141983:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.141989:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005eebb678/0xbcb9e331c3f10de3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.142001:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005eebb678/0xbcb9e331c3f10de3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.142025:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005eebb678/0xbcb9e331c3f10de3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.142032:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005eebb678/0xbcb9e331c3f10de3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.144244:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432906.144430:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432906.144440:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005eebb678/0xbcb9e331c3f10de3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.144462:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bc2166200 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432906.144467:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005eebb678/0xbcb9e331c3f10de3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.144477:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005eebb678/0xbcb9e331c3f10de3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.144509:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005eebb678/0xbcb9e331c3f10de3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.144516:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005eebb678/0xbcb9e331c3f10de3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.144553:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432906.144555:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432906.144557:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432906.145984:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.145994:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10dea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.146009:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.146014:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.146020:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10dea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.146033:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10dea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.146043:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10dea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.146051:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10dea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.146157:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787432906.147036:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432906.147047:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10dea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.147057:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031400 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432906.147061:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10dea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.147082:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10dea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.147101:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10dea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.147108:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ccbbc6f/0xbcb9e331c3f10dea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.147137:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432906.147139:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432906.147141:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787432906.147476:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.147483:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f10df1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.147495:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.147579:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.147586:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f10df1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.147597:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f10df1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.147605:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f10df1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.147612:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f10df1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.147686:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787432906.148461:0:15042:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787432906.148469:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10df8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.148480:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1787432906.148489:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432906.148494:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10df8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.148723:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10df8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.148733:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10df8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432906.148740:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10df8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.150327:0:15366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787432906.150340:0:15366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f10df1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.150352:0:15366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030200 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432906.150357:0:15366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f10df1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.150368:0:15366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f10df1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.150391:0:15366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f10df1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.150416:0:15366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f10df1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.150443:0:15366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787432906.150447:0:15366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10df8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.150453:0:15366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030000 already unused, calling callback (ffffffffc1752230) 00010000:00010000:2.0:1787432906.150456:0:15366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10df8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.152331:0:15366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10df8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.152355:0:15366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10df8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432906.152367:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432906.152369:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432906.152372:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432906.152911:0:15042:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787432906.152921:0:15042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074cc3fe1/0xbcb9e331c3f10df8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787432906.153776:0:15042:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1787432906.153883:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14380:x1874258812836992:12345-0@lo:5:osp-pre-1-0.0 Request processed in 155760us (156268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432906.153895:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787432906.154156:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad10e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14380:1874258812836992:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787432906.154179:0:14380:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1787432906.154239:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad2aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14380:1874258812837376:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787432906.154278:0:14380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432906.154340:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91a67600 going to sleep for 11 seconds 00000100:00100000:3.0:1787432906.154651:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812837376 00000100:00100000:3.0:1787432906.154701:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812837376 00000100:00100000:3.0:1787432906.154747:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787432906.154757:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14380:x1874258812837376:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787432906.154813:0:15040:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1787432906.159425:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432906.182247:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14380:x1874258812837376:12345-0@lo:5:osp-pre-1-0.0 Request processed in 27483us (27960us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787432906.182262:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787432906.183460:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad2aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14380:1874258812837376:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787432906.183482:0:14380:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1787432906.488748:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432906.488778:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812837504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432906.488848:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432906.488935:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812837504 00000100:00100000:1.0:1787432906.488942:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812837504 00000100:00100000:1.0:1787432906.488997:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787432906.489008:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812837504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432906.489045:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432906.489092:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812837504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432906.489099:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787432906.489145:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812837504:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787432906.875552:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787432907.894269:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787432908.727341:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1787432908.856055:0:16119:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787432908.927283:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787432909.941847:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432910.966531:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432911.099954:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d00b432-f54a-428d-8e42-8523236fbac8:3333:1874258812837632:0@lo:400:kworker.0 00000100:00100000:2.0:1787432911.100196:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432911.100253:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812838144:0@lo:400:kworker.0 00000100:00100000:2.0:1787432911.100280:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432911.100308:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787432911.100313:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812838016:0@lo:400:kworker.0 00000100:00100000:2.0:1787432911.100334:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432911.100364:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812837760:0@lo:400:kworker.0 00000100:00100000:2.0:1787432911.100392:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432911.100408:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812838272:0@lo:400:kworker.0 00000100:00100000:2.0:1787432911.100449:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432911.100467:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432911.100471:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812837888:0@lo:400:kworker.0 00000100:00100000:2.0:1787432911.100516:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432911.100550:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812837632 00000100:00100000:2.0:1787432911.100557:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812837632 00000100:00100000:3.0:1787432911.101429:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812837760 00000100:00100000:3.0:1787432911.101439:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812837760 00000100:00100000:3.0:1787432911.101534:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812837888 00000100:00100000:3.0:1787432911.101537:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812837888 00000100:00100000:3.0:1787432911.101562:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432911.101574:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812837760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432911.101692:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812837760:12345-0@lo:400:kworker.0 Request processed in 120us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432911.101700:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787432911.101720:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787432911.101729:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3330:x1874258812837888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432911.101762:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3330:x1874258812837888:12345-0@lo:400:kworker.0 Request processed in 36us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432911.101768:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787432911.101821:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812837888:0@lo:400:kworker.0 00000100:00100000:3.0:1787432911.101836:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812837760:0@lo:400:kworker.0 00000100:00100000:2.0:1787432911.102260:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787432911.102268:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+19:3333:x1874258812837632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432911.102313:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+19:3333:x1874258812837632:12345-0@lo:400:kworker.0 Request processed in 46us (2117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432911.102319:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787432911.102354:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812838144 00000100:00100000:2.0:1787432911.102359:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812838144 00000100:00100000:2.0:1787432911.102384:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812838016 00000100:00100000:2.0:1787432911.102388:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812838016 00000100:00100000:2.0:1787432911.102414:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812838272 00000100:00100000:2.0:1787432911.102417:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812838272 00000100:00100000:2.0:1787432911.102430:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787432911.102435:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812838144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432911.102468:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3333:x1874258812838144:12345-0@lo:400:kworker.0 Request processed in 32us (2187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432911.102488:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787432911.102509:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787432911.102516:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812838016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432911.102546:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812838016:12345-0@lo:400:kworker.0 Request processed in 30us (2210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432911.102551:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787432911.103741:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787432911.103755:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812838272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432911.103812:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812838272:12345-0@lo:400:kworker.0 Request processed in 62us (3363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432911.103818:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787432911.103855:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812838400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787432911.103888:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787432911.103945:0:3330:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb95ace00 x1874258812838272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787432911.103958:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812838272:0@lo:400:kworker.0 00000100:00080000:2.0:1787432911.104233:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787432911.104239:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787432911.104241:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787432911.104272:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb95afb80 x1874258812838016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432911.104283:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812838016:0@lo:400:kworker.0 00000100:00100000:2.0:1787432911.104292:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d00b432-f54a-428d-8e42-8523236fbac8:3333:1874258812837632:0@lo:400:kworker.0 00010000:00080000:2.0:1787432911.104302:0:3333:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff935bb95adf80 x1874258812838144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787432927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787432911.104309:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3333:1874258812838144:0@lo:400:kworker.0 00000100:00100000:1.0:1787432911.105387:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812838400 00000100:00100000:1.0:1787432911.105395:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812838400 00000100:00100000:1.0:1787432911.105435:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787432911.105443:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3331:x1874258812838400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787432911.105471:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432911.105554:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3331:x1874258812838400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432911.107304:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787432911.107405:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812838400:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787432911.204168:0:7682:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1787432911.204223:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787432911.605950:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787432911.605970:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812838528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432911.606026:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432911.606240:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812838528 00000100:00100000:1.0:1787432911.606247:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812838528 00000100:00100000:1.0:1787432911.606293:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787432911.606301:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812838528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432911.606335:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432911.606394:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812838528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432911.606399:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787432911.606471:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812838528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787432911.703267:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432911.703444:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791867520 00000100:00100000:2.0:1787432911.703462:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791867520 00000100:00100000:2.0:1787432911.703555:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 78 00000100:00100000:2.0:1787432911.703565:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2374:x1874258791867520:12345-192.168.202.15@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787432911.703598:0:14347:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d50bdb12-e88c-4003-a207-6f70712558c4@192.168.202.15@tcp t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:2.0:1787432911.703632:0:14347:0:(genops.c:1385:class_connect()) connect: client d50bdb12-e88c-4003-a207-6f70712558c4, cookie 0xbcb9e331c3f10dff 00000100:00080000:2.0:1787432911.703900:0:14347:0:(import.c:65:import_set_state_nolock()) ffff935ba9823000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432911.703978:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+5:2374:x1874258791867520:12345-192.168.202.15@tcp:250:mount.lustre.0 Request processed in 413us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432911.703986:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 78 00000100:00100000:2.0:1787432911.738164:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432911.741461:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791867648 00000100:00100000:0.0:1787432911.741502:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791867648 00000100:00100000:0.0:1787432911.742966:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 79 00000100:00100000:0.0:1787432911.742986:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+5:13780:x1874258791867648:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787432911.743030:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432911.743056:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba1cf800/0xbcb9e331c3f10e06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a025fa3 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432911.743097:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba1cf800/0xbcb9e331c3f10e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025fa3 expref: 6 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432911.743110:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba1cf800/0xbcb9e331c3f10e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025fa3 expref: 6 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432911.743123:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cf800, rc 0) 00000100:00100000:0.0:1787432911.743251:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+6:13780:x1874258791867648:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 270us (5099us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432911.743260:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 79 00000100:00100000:1.0:1787432911.758869:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432911.760206:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791867776 00000100:00100000:2.0:1787432911.760225:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791867776 00000100:00100000:2.0:1787432911.760318:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 80 00000100:00100000:2.0:1787432911.760341:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+6:13780:x1874258791867776:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787432911.761614:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+6:13780:x1874258791867776:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 1262us (2757us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787432911.761633:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 80 00000100:00100000:1.0:1787432911.808937:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432911.809131:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791867904 00000100:00100000:3.0:1787432911.809146:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791867904 00000100:00100000:3.0:1787432911.809233:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:3.0:1787432911.809245:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+6:13780:x1874258791867904:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787432911.809271:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432911.809295:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935b80030c00/0xbcb9e331c3f10e0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a025faa expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432911.809380:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935b80030c00/0xbcb9e331c3f10e0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025faa expref: 7 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432911.809394:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935b80030c00/0xbcb9e331c3f10e0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025faa expref: 7 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432911.809413:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80030c00, rc 0) 00000100:00100000:3.0:1787432911.810994:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+7:13780:x1874258791867904:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 267us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432911.811016:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:1.0:1787432911.822071:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432911.822213:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791868032 00000100:00100000:0.0:1787432911.822227:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791868032 00000100:00100000:0.0:1787432911.822299:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 82 00000100:00100000:0.0:1787432911.822311:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+7:13780:x1874258791868032:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787432911.837077:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+8:13780:x1874258791868032:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 14749us (15007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432911.837095:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 82 00000100:00100000:1.0:1787432911.843983:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432911.848722:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791868160 00000100:00100000:2.0:1787432911.848744:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791868160 00000100:00100000:2.0:1787432911.848846:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 83 00000100:00100000:2.0:1787432911.848860:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b87c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+8:13780:x1874258791868160:12345-192.168.202.15@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787432911.853744:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b87c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+8:13780:x1874258791868160:12345-192.168.202.15@tcp:503:mount.lustre.0 Request processed in 4864us (9755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432911.853766:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 83 00000100:00100000:1.0:1787432911.875005:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432911.875256:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791868288 00000100:00100000:2.0:1787432911.875269:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791868288 00000100:00100000:2.0:1787432911.875346:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00100000:2.0:1787432911.875358:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbd6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+8:13799:x1874258791868288:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787432911.876916:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbd6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+8:13799:x1874258791868288:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 1545us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432911.876933:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00100000:0.0:1787432911.903947:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432911.904354:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791868416 00000100:00100000:3.0:1787432911.904369:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791868416 00000100:00100000:3.0:1787432911.904457:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 85 00000100:00100000:3.0:1787432911.904479:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbd6bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+8:13799:x1874258791868416:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787432911.904976:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbd6bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+8:13799:x1874258791868416:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 503us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432911.904986:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 85 00000100:00100000:0.0:1787432911.938951:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432911.939339:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791868544 00000100:00100000:1.0:1787432911.939355:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791868544 00000100:00100000:1.0:1787432911.939434:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 86 00000100:00100000:1.0:1787432911.939445:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbd6bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+8:13780:x1874258791868544:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787432911.939475:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432911.939508:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba8e6e00/0xbcb9e331c3f10e14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a025fd4 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432911.939554:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba8e6e00/0xbcb9e331c3f10e14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025fd4 expref: 9 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432911.939566:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba8e6e00/0xbcb9e331c3f10e14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025fd4 expref: 9 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432911.939577:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e6e00, rc 0) 00000100:00100000:1.0:1787432911.939704:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbd6bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+9:13780:x1874258791868544:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 212us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432911.939733:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 86 00000100:00100000:1.0:1787432911.967730:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432911.970852:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791868672 00000100:00100000:3.0:1787432911.970875:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791868672 00000100:00100000:3.0:1787432911.970991:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 87 00000100:00100000:3.0:1787432911.971005:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbd6b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+9:13780:x1874258791868672:12345-192.168.202.15@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787432911.971047:0:14350:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787432911.971161:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787432911.971167:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787432911.971170:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787432911.971173:0:14350:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787432911.983365:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbd6b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+9:13780:x1874258791868672:12345-192.168.202.15@tcp:256:mount.lustre.0 Request processed in 12344us (15631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432911.983387:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 87 00010000:00010000:3.0:1787432911.989924:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432911.990076:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432911.990160:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791868800 00000100:00100000:3.0:1787432911.990177:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791868800 00000100:00100000:3.0:1787432911.990260:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 88 00000100:00100000:3.0:1787432911.990274:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbd6ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+9:13780:x1874258791868800:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787432911.990299:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432911.990326:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935b80030000/0xbcb9e331c3f10e1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a025fdb expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432911.990384:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935b80030000/0xbcb9e331c3f10e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025fdb expref: 10 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432911.990398:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935b80030000/0xbcb9e331c3f10e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025fdb expref: 10 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432911.990410:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80030000, rc 0) 00000100:00100000:3.0:1787432911.990507:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbd6ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+10:13780:x1874258791868800:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 236us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432911.990516:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 88 00000100:00100000:1.0:1787432911.993919:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432911.994483:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791868928 00000100:00100000:3.0:1787432911.994509:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791868928 00000100:00100000:3.0:1787432911.994599:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 89 00000100:00100000:3.0:1787432911.994612:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbd6bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+10:13780:x1874258791868928:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787432911.995132:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbd6bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+10:13780:x1874258791868928:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 519us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432911.995154:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 89 00000100:00100000:0.0:1787432912.001077:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432912.001561:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791869056 00000100:00100000:1.0:1787432912.001579:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791869056 00000100:00100000:1.0:1787432912.001698:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 90 00000100:00100000:1.0:1787432912.001711:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbd6b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+10:13780:x1874258791869056:12345-192.168.202.15@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787432912.002922:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbd6b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+10:13780:x1874258791869056:12345-192.168.202.15@tcp:503:mount.lustre.0 Request processed in 1203us (1851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432912.002938:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 90 00000100:00100000:1.0:1787432912.023837:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432912.024119:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791869184 00000100:00100000:2.0:1787432912.024135:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791869184 00000100:00100000:2.0:1787432912.024221:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 91 00000100:00100000:2.0:1787432912.024234:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbd6b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+10:13803:x1874258791869184:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787432912.024731:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbd6b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+10:13803:x1874258791869184:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 498us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432912.024741:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 91 00000100:00100000:2.0:1787432912.044242:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432912.045160:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791869312 00000100:00100000:1.0:1787432912.045180:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791869312 00000100:00100000:1.0:1787432912.045289:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 92 00000100:00100000:1.0:1787432912.045302:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbd6b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+10:13803:x1874258791869312:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787432912.046023:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbd6b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+10:13803:x1874258791869312:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 718us (1804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432912.046035:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 92 00000100:00100000:0.0:1787432912.092089:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432912.102908:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791869440 00000100:00100000:2.0:1787432912.102930:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791869440 00000100:00100000:2.0:1787432912.103010:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:2.0:1787432912.103023:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2374:x1874258791869440:12345-192.168.202.15@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787432912.103067:0:15772:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1437e822-c48b-4d58-8b99-8f0f7949835b@192.168.202.15@tcp t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:2.0:1787432912.103162:0:15772:0:(genops.c:1385:class_connect()) connect: client 1437e822-c48b-4d58-8b99-8f0f7949835b, cookie 0xbcb9e331c3f10e22 00000004:00100000:2.0:1787432912.103207:0:15772:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787432912.103325:0:15772:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1787432912.187105:0:15772:0:(import.c:65:import_set_state_nolock()) ffff935b98a83800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787432912.187293:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+6:2374:x1874258791869440:12345-192.168.202.15@tcp:38:mount.lustre.0 Request processed in 84267us (95214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432912.187306:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:0.0:1787432912.191459:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432912.191560:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791869568 00000100:00100000:2.0:1787432912.191576:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791869568 00000100:00080000:3.0:1787432912.191717:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432912.192022:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432912.193994:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791869696 00000100:00100000:2.0:1787432912.194097:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791869696 00000100:00100000:1.0:1787432912.194218:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:1.0:1787432912.194242:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+7:0:x1874258791869568:12345-192.168.202.15@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787432912.194515:0:14356:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787432912.194731:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+7:0:x1874258791869568:12345-192.168.202.15@tcp:41:mount.lustre.0 Request processed in 499us (3288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432912.194740:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:1.0:1787432912.194774:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:1.0:1787432912.194785:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+6:13780:x1874258791869696:12345-192.168.202.15@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787432912.194801:0:14356:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787432912.194905:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+6:13780:x1874258791869696:12345-192.168.202.15@tcp:41:mount.lustre.0 Request processed in 122us (2884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432912.194912:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:2.0:1787432912.198119:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432912.198399:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791869824 00000100:00100000:3.0:1787432912.198425:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791869824 00000100:00100000:3.0:1787432912.199032:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:3.0:1787432912.199047:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+6:13780:x1874258791869824:12345-192.168.202.15@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787432912.199981:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+6:13780:x1874258791869824:12345-192.168.202.15@tcp:40:mount.lustre.0 Request processed in 932us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432912.199994:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:0.0:1787432912.208000:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432912.208048:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432912.208099:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432912.208294:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791869952 00000100:00100000:3.0:1787432912.208311:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791869952 00000100:00100000:1.0:1787432912.208765:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791870208 00000100:00100000:1.0:1787432912.208771:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791870208 00000100:00100000:1.0:1787432912.208823:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:1.0:1787432912.208835:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+6:13780:x1874258791870208:12345-192.168.202.15@tcp:33:mount.lustre.0 00000100:00100000:3.0:1787432912.209727:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791870080 00000100:00100000:3.0:1787432912.209735:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791870080 00000100:00100000:3.0:1787432912.209763:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:3.0:1787432912.209770:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2374:x1874258791869952:12345-192.168.202.15@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787432912.209801:0:15042:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1437e822-c48b-4d58-8b99-8f0f7949835b@192.168.202.15@tcp t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:3.0:1787432912.209840:0:15042:0:(genops.c:1385:class_connect()) connect: client 1437e822-c48b-4d58-8b99-8f0f7949835b, cookie 0xbcb9e331c3f10e29 00002000:00100000:3.0:1787432912.209855:0:15042:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1437e822-c48b-4d58-8b99-8f0f7949835b/ffff935bbb687800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787432912.209868:0:15042:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787432912.211873:0:15042:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787432912.211939:0:15042:0:(import.c:65:import_set_state_nolock()) ffff935bbb684800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787432912.212064:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+6:2374:x1874258791869952:12345-192.168.202.15@tcp:8:mount.lustre.0 Request processed in 2291us (4077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432912.212079:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:3.0:1787432912.212131:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:3.0:1787432912.212610:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2374:x1874258791870080:12345-192.168.202.15@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787432912.212675:0:15042:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1437e822-c48b-4d58-8b99-8f0f7949835b@192.168.202.15@tcp t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:3.0:1787432912.212717:0:15042:0:(genops.c:1385:class_connect()) connect: client 1437e822-c48b-4d58-8b99-8f0f7949835b, cookie 0xbcb9e331c3f10e30 00002000:00100000:3.0:1787432912.212734:0:15042:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1437e822-c48b-4d58-8b99-8f0f7949835b/ffff935bbb687000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787432912.212749:0:15042:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787432912.213170:0:15042:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787432912.213202:0:15042:0:(import.c:65:import_set_state_nolock()) ffff935bbb685000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787432912.213255:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+6:2374:x1874258791870080:12345-192.168.202.15@tcp:8:mount.lustre.0 Request processed in 648us (5155us total) trans 0 rc 0/0 00000004:00080000:1.0:1787432912.214070:0:14358:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5136us 00000100:00100000:3.0:1787432912.223599:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000004:00200000:1.0:1787432912.251305:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787432912.252285:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+6:13780:x1874258791870208:12345-192.168.202.15@tcp:33:mount.lustre.0 Request processed in 43436us (44219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432912.252317:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:0.0:1787432912.551809:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432912.552012:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791870336 00000100:00100000:3.0:1787432912.552026:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791870336 00000100:00100000:3.0:1787432912.552109:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:3.0:1787432912.552123:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+6:13824:x1874258791870336:12345-192.168.202.15@tcp:101:mkdir.0 00010000:00010000:3.0:1787432912.552162:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432912.552199:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030400/0xbcb9e331c3f10e37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a026005 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.552289:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f10e3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.552307:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f10e3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.552338:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f10e3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432912.553063:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787432912.553070:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432912.553193:0:14357:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f10e3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.553235:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030400/0xbcb9e331c3f10e37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026005 expref: 8 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.553257:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f10e3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026005 expref: 7 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432912.553269:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9826d200) 00010000:00010000:3.0:1787432912.553272:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432912.553277:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80031000, rc 0) 00000100:00100000:3.0:1787432912.553390:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+7:13824:x1874258791870336:12345-192.168.202.15@tcp:101:mkdir.0 Request processed in 1269us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432912.553407:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00010000:00010000:2.0:1787432913.015758:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432914.038978:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787432914.751008:0:6749:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1437e822-c48b-4d58-8b99-8f0f7949835b 00000100:00100000:0.0:1787432914.986235:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432914.986349:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791870464 00000100:00100000:2.0:1787432914.986364:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791870464 00000100:00100000:2.0:1787432914.986478:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00080000:3.0:1787432914.986484:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432914.986493:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+7:13877:x1874258791870464:12345-192.168.202.15@tcp:41:lfs.0 00000004:00000024:2.0:1787432914.986556:0:15772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787432914.986725:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+7:13877:x1874258791870464:12345-192.168.202.15@tcp:41:lfs.0 Request processed in 235us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432914.986734:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:0.0:1787432914.996593:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432914.998150:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791870592 00000100:00100000:1.0:1787432914.998172:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791870592 00000100:00100000:1.0:1787432914.998295:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:1.0:1787432914.998319:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1437e822-c48b-4d58-8b99-8f0f7949835b+5:13877:x1874258791870592:12345-192.168.202.15@tcp:13:lfs.0 00000100:00080000:3.0:1787432914.998336:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787432914.998377:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432914.998519:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1437e822-c48b-4d58-8b99-8f0f7949835b+5:13877:x1874258791870592:12345-192.168.202.15@tcp:13:lfs.0 Request processed in 212us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432914.998549:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:1.0:1787432915.005265:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432915.006022:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791870720 00000100:00100000:2.0:1787432915.006039:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791870720 00000100:00100000:2.0:1787432915.006152:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:2.0:1787432915.006165:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1437e822-c48b-4d58-8b99-8f0f7949835b+6:13877:x1874258791870720:12345-192.168.202.15@tcp:13:lfs.0 00002000:00000024:2.0:1787432915.006228:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432915.006363:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1437e822-c48b-4d58-8b99-8f0f7949835b+6:13877:x1874258791870720:12345-192.168.202.15@tcp:13:lfs.0 Request processed in 200us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432915.006371:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00080000:3.0:1787432915.006598:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787432915.062149:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432915.316510:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432915.316623:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791870848 00000100:00100000:3.0:1787432915.316638:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791870848 00000100:00100000:3.0:1787432915.316747:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 93 00000100:00100000:3.0:1787432915.316762:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbd6bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+10:13909:x1874258791870848:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787432915.316785:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432915.316810:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935b80030400/0xbcb9e331c3f10e45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a02600c expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432915.316869:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935b80030400/0xbcb9e331c3f10e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02600c expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432915.316882:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935b80030400/0xbcb9e331c3f10e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02600c expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432915.316895:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80030400, rc 0) 00000100:00100000:3.0:1787432915.316986:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbd6bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+11:13909:x1874258791870848:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 228us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432915.316995:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 93 00000100:00100000:1.0:1787432915.337566:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432915.341333:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791870976 00000100:00100000:2.0:1787432915.341358:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791870976 00000100:00100000:2.0:1787432915.341467:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 94 00000100:00100000:2.0:1787432915.341483:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+11:13909:x1874258791870976:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787432915.342597:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+11:13909:x1874258791870976:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 523us (4450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432915.342612:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 94 00000100:00100000:0.0:1787432915.350951:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432915.351128:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791871104 00000100:00100000:1.0:1787432915.351144:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791871104 00000100:00100000:1.0:1787432915.351221:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 95 00000100:00100000:1.0:1787432915.351235:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+11:13909:x1874258791871104:12345-192.168.202.15@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787432915.351947:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+11:13909:x1874258791871104:12345-192.168.202.15@tcp:503:mount.lustre.0 Request processed in 711us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432915.351959:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 95 00000100:00100000:1.0:1787432915.373724:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432915.373898:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791871232 00000100:00100000:2.0:1787432915.373911:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791871232 00000100:00100000:2.0:1787432915.373979:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 96 00000100:00100000:2.0:1787432915.373993:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+11:13916:x1874258791871232:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787432915.374509:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+11:13916:x1874258791871232:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 516us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432915.374519:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 96 00000100:00100000:0.0:1787432915.426130:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432915.426270:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791871360 00000100:00100000:1.0:1787432915.426285:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791871360 00000100:00100000:1.0:1787432915.426369:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 97 00000100:00100000:1.0:1787432915.426391:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+11:13916:x1874258791871360:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787432915.426854:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+11:13916:x1874258791871360:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 466us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432915.426864:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 97 00000100:00100000:1.0:1787432915.451911:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432915.452045:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791871488 00000100:00100000:0.0:1787432915.452058:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791871488 00000100:00100000:0.0:1787432915.452130:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 98 00000100:00100000:0.0:1787432915.452142:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+11:13909:x1874258791871488:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787432915.452166:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432915.452191:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba1cfe00/0xbcb9e331c3f10e4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a026036 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432915.452228:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba1cfe00/0xbcb9e331c3f10e4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026036 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432915.452240:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba1cfe00/0xbcb9e331c3f10e4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026036 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432915.452251:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cfe00, rc 0) 00000100:00100000:0.0:1787432915.452349:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+12:13909:x1874258791871488:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 208us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432915.452356:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 98 00000100:00100000:3.0:1787432915.459392:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432915.459645:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791871616 00000100:00100000:2.0:1787432915.459713:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791871616 00000100:00100000:2.0:1787432915.459789:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 99 00000100:00100000:2.0:1787432915.459800:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+12:13909:x1874258791871616:12345-192.168.202.15@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787432915.459838:0:14349:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787432915.459872:0:14349:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787432915.459877:0:14349:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787432915.459880:0:14349:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787432915.459883:0:14349:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787432915.470282:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+12:13909:x1874258791871616:12345-192.168.202.15@tcp:256:mount.lustre.0 Request processed in 10464us (10895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432915.470304:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 99 00000100:00100000:1.0:1787432915.483972:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432915.484238:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791871744 00000100:00100000:2.0:1787432915.484273:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791871744 00000100:00100000:2.0:1787432915.484497:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 100 00000100:00100000:2.0:1787432915.484511:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+12:13909:x1874258791871744:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787432915.485742:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432915.485778:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bbaa5f800/0xbcb9e331c3f10e53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a02603d expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432915.485828:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bbaa5f800/0xbcb9e331c3f10e53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02603d expref: 13 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432915.485841:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bbaa5f800/0xbcb9e331c3f10e53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02603d expref: 13 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432915.485871:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f800, rc 0) 00000100:00100000:2.0:1787432915.485974:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+13:13909:x1874258791871744:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 1464us (2024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432915.485984:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 100 00000100:00100000:1.0:1787432915.494114:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432915.502205:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791871872 00000100:00100000:0.0:1787432915.502231:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791871872 00000100:00100000:0.0:1787432915.502341:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 101 00000100:00100000:0.0:1787432915.502354:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+13:13909:x1874258791871872:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787432915.503635:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+13:13909:x1874258791871872:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 1271us (9524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432915.503649:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 101 00000100:00100000:2.0:1787432915.512449:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432915.512747:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791872000 00000100:00100000:0.0:1787432915.512771:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791872000 00000100:00100000:0.0:1787432915.512863:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 102 00000100:00100000:0.0:1787432915.512883:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+13:13909:x1874258791872000:12345-192.168.202.15@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787432915.513651:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+13:13909:x1874258791872000:12345-192.168.202.15@tcp:503:mount.lustre.0 Request processed in 416us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432915.513700:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 102 00000100:00100000:1.0:1787432915.516359:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432915.516598:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791872128 00000100:00100000:3.0:1787432915.516611:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791872128 00000100:00100000:3.0:1787432915.516794:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 103 00000100:00100000:3.0:1787432915.516806:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+13:13921:x1874258791872128:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787432915.518149:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+13:13921:x1874258791872128:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 1330us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432915.518165:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 103 00000100:00100000:1.0:1787432915.531082:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432915.531219:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791872256 00000100:00100000:2.0:1787432915.531232:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791872256 00000100:00100000:2.0:1787432915.531313:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 104 00000100:00100000:2.0:1787432915.531325:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+13:13921:x1874258791872256:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787432915.531767:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+13:13921:x1874258791872256:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 442us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432915.531776:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 104 00000100:00100000:2.0:1787432915.538055:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432915.544741:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791872384 00000100:00100000:3.0:1787432915.544763:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791872384 00000100:00100000:2.0:1787432915.545936:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:2.0:1787432915.545949:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2374:x1874258791872384:12345-192.168.202.15@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787432915.545992:0:14357:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3518b7f2-8018-4ccd-b342-b1564cc6e0dc@192.168.202.15@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:2.0:1787432915.546047:0:14357:0:(genops.c:1385:class_connect()) connect: client 3518b7f2-8018-4ccd-b342-b1564cc6e0dc, cookie 0xbcb9e331c3f10e5a 00000004:00100000:2.0:1787432915.546093:0:14357:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787432915.546270:0:14357:0:(import.c:65:import_set_state_nolock()) ffff935bbd7b3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787432915.546404:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+6:2374:x1874258791872384:12345-192.168.202.15@tcp:38:mount.lustre.0 Request processed in 454us (8364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432915.546414:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:1.0:1787432915.557950:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432915.558423:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791872640 00000100:00100000:3.0:1787432915.558436:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791872640 00000100:00100000:3.0:1787432915.558539:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:3.0:1787432915.558569:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+6:13909:x1874258791872640:12345-192.168.202.15@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787432915.558645:0:15772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1787432915.558909:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432915.559087:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432915.559180:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791872512 00000100:00100000:1.0:1787432915.559185:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791872512 00000100:00100000:1.0:1787432915.559221:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:1.0:1787432915.559229:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+7:0:x1874258791872512:12345-192.168.202.15@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787432915.559245:0:14356:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787432915.559322:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+7:0:x1874258791872512:12345-192.168.202.15@tcp:41:mount.lustre.0 Request processed in 93us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432915.559331:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:0.0:1787432915.560466:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+6:13909:x1874258791872640:12345-192.168.202.15@tcp:41:mount.lustre.0 Request processed in 1878us (2509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432915.560478:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:0.0:1787432915.568270:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432915.568515:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791872768 00000100:00100000:1.0:1787432915.568529:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791872768 00000100:00100000:1.0:1787432915.568617:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:1.0:1787432915.568631:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+6:13909:x1874258791872768:12345-192.168.202.15@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787432915.568797:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+6:13909:x1874258791872768:12345-192.168.202.15@tcp:40:mount.lustre.0 Request processed in 166us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432915.568806:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:1.0:1787432915.576709:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432915.577206:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432915.577239:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432915.577267:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432915.577306:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432915.577339:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432915.577365:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432915.577527:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791872896 00000100:00100000:3.0:1787432915.577543:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791872896 00000100:00100000:3.0:1787432915.577586:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791873024 00000100:00100000:3.0:1787432915.577588:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791873024 00000100:00100000:3.0:1787432915.577599:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791873664 00000100:00100000:3.0:1787432915.577602:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791873664 00000100:00100000:3.0:1787432915.577639:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:3.0:1787432915.577653:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+6:2376:x1874258791873664:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432915.577780:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+6:2376:x1874258791873664:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 129us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432915.577789:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:3.0:1787432915.577810:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:3.0:1787432915.577815:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2374:x1874258791872896:12345-192.168.202.15@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787432915.577849:0:15041:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3518b7f2-8018-4ccd-b342-b1564cc6e0dc@192.168.202.15@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:3.0:1787432915.577891:0:15041:0:(genops.c:1385:class_connect()) connect: client 3518b7f2-8018-4ccd-b342-b1564cc6e0dc, cookie 0xbcb9e331c3f10e61 00002000:00100000:3.0:1787432915.577906:0:15041:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3518b7f2-8018-4ccd-b342-b1564cc6e0dc/ffff935bbb684000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787432915.577920:0:15041:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787432915.578236:0:15041:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787432915.578277:0:15041:0:(import.c:65:import_set_state_nolock()) ffff935bbb683000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787432915.578337:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+6:2374:x1874258791872896:12345-192.168.202.15@tcp:8:mount.lustre.0 Request processed in 519us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432915.578344:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:3.0:1787432915.578361:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:3.0:1787432915.578541:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2374:x1874258791873024:12345-192.168.202.15@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787432915.578564:0:15041:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3518b7f2-8018-4ccd-b342-b1564cc6e0dc@192.168.202.15@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:3.0:1787432915.578591:0:15041:0:(genops.c:1385:class_connect()) connect: client 3518b7f2-8018-4ccd-b342-b1564cc6e0dc, cookie 0xbcb9e331c3f10e68 00002000:00100000:3.0:1787432915.578598:0:15041:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3518b7f2-8018-4ccd-b342-b1564cc6e0dc/ffff935ba6ace800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211393f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787432915.578606:0:15041:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787432915.578703:0:15041:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787432915.578726:0:15041:0:(import.c:65:import_set_state_nolock()) ffff935ba6acf000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787432915.578755:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+6:2374:x1874258791873024:12345-192.168.202.15@tcp:8:mount.lustre.0 Request processed in 214us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432915.578763:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:3.0:1787432915.578798:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791873280 00000100:00100000:3.0:1787432915.578804:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791873280 00000100:00100000:3.0:1787432915.578846:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 105 00000100:00100000:3.0:1787432915.578853:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+13:2376:x1874258791873280:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432915.578882:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+13:2376:x1874258791873280:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 29us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432915.578889:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 105 00000100:00100000:3.0:1787432915.578969:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791873408 00000100:00100000:3.0:1787432915.578974:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791873408 00000100:00100000:3.0:1787432915.579006:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:3.0:1787432915.579014:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+7:2376:x1874258791873408:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432915.579045:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+7:2376:x1874258791873408:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 33us (1777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432915.579052:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:1.0:1787432915.579578:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791873536 00000100:00100000:1.0:1787432915.579583:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791873536 00000100:00100000:1.0:1787432915.579620:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:1.0:1787432915.579628:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+5:2376:x1874258791873536:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432915.579686:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+5:2376:x1874258791873536:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 59us (2319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432915.579693:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:0.0:1787432915.584703:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791873152 00000100:00100000:0.0:1787432915.584727:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791873152 00000100:00100000:0.0:1787432915.584805:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:0.0:1787432915.584818:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+6:13909:x1874258791873152:12345-192.168.202.15@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787432915.585148:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787432915.585501:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+6:13909:x1874258791873152:12345-192.168.202.15@tcp:33:mount.lustre.0 Request processed in 683us (8807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432915.585513:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:3.0:1787432915.764763:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432915.764969:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791873792 00000100:00100000:1.0:1787432915.764983:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791873792 00000100:00100000:1.0:1787432915.765065:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:1.0:1787432915.765077:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+6:13942:x1874258791873792:12345-192.168.202.15@tcp:101:mkdir.0 00010000:00010000:1.0:1787432915.765105:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432915.765136:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f10e6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a026067 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432915.765222:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10e76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432915.765239:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432915.765254:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432915.765551:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787432915.765556:0:14356:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787432915.765645:0:14356:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432915.765734:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f10e6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026067 expref: 8 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432915.765755:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10e76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026067 expref: 7 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432915.765774:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9826d200) 00010000:00010000:1.0:1787432915.765777:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787432915.765781:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e7800, rc 0) 00000100:00100000:1.0:1787432915.765867:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+7:13942:x1874258791873792:12345-192.168.202.15@tcp:101:mkdir.0 Request processed in 791us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432915.765875:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00010000:00010000:2.0:1787432916.086135:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432916.215504:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812838656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787432916.215617:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432916.216263:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812838656 00000100:00100000:0.0:1787432916.216275:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812838656 00000100:00100000:0.0:1787432916.216378:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787432916.216392:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812838656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787432916.216421:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787432916.216920:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812838656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 530us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432916.216930:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787432916.217995:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d00b432-f54a-428d-8e42-8523236fbac8:3330:1874258812838784:0@lo:400:kworker.0 00000100:00100000:2.0:1787432916.218066:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432916.218120:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812839296:0@lo:400:kworker.0 00000100:00100000:2.0:1787432916.218150:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432916.218174:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432916.218180:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812838912:0@lo:400:kworker.0 00000100:00100000:2.0:1787432916.218208:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432916.218240:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812839040:0@lo:400:kworker.0 00000100:00100000:2.0:1787432916.218263:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432916.218281:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787432916.218286:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3332:1874258812839168:0@lo:400:kworker.0 00000100:00100000:2.0:1787432916.218306:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432916.218338:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812839296 00000100:00100000:2.0:1787432916.218344:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812839296 00000100:00100000:2.0:1787432916.218391:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812839040 00000100:00100000:2.0:1787432916.218394:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812839040 00000100:00100000:2.0:1787432916.218407:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812839168 00000100:00100000:2.0:1787432916.218410:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812839168 00000100:00100000:2.0:1787432916.218427:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787432916.218435:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812839296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432916.218498:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3330:x1874258812839296:12345-0@lo:400:kworker.0 Request processed in 64us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432916.218506:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787432916.218602:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787432916.218609:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812839040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432916.218647:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3332:x1874258812839040:12345-0@lo:400:kworker.0 Request processed in 38us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432916.218698:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787432916.218711:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787432916.218718:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1874258812839168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432916.218748:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1874258812839168:12345-0@lo:400:kworker.0 Request processed in 31us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432916.218755:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787432916.218805:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3332:1874258812839168:0@lo:400:kworker.0 00000100:00100000:2.0:1787432916.218818:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3332:1874258812839040:0@lo:400:kworker.0 00000100:00080000:1.0:1787432916.223129:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787432916.223146:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787432916.223207:0:3333:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787432916.223254:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812838656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432916.226695:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812838912 00000100:00100000:3.0:1787432916.226722:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812838912 00000100:00100000:3.0:1787432916.226841:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432916.226856:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812838912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432916.227013:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812838912:12345-0@lo:400:kworker.0 Request processed in 161us (8802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432916.227022:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787432916.227229:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812838912:0@lo:400:kworker.0 00000100:00100000:3.0:1787432916.227250:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3330:1874258812839296:0@lo:400:kworker.0 00000100:00100000:0.0:1787432916.232609:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812838784 00000100:00100000:0.0:1787432916.232634:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812838784 00000100:00100000:0.0:1787432916.232744:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787432916.232759:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbc43c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+19:3330:x1874258812838784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432916.232881:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbc43c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+19:3330:x1874258812838784:12345-0@lo:400:kworker.0 Request processed in 125us (14813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432916.232889:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1787432916.232955:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787432916.233153:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d00b432-f54a-428d-8e42-8523236fbac8:3330:1874258812838784:0@lo:400:kworker.0 00000001:00100000:3.0:1787432916.311240:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3518b7f2-8018-4ccd-b342-b1564cc6e0dc 00000001:00100000:3.0:1787432916.311261:0:7682:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1437e822-c48b-4d58-8b99-8f0f7949835b 00000100:00100000:1.0:1787432916.728155:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812839424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787432916.728248:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432916.728510:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812839424 00000100:00100000:1.0:1787432916.728520:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812839424 00000100:00100000:1.0:1787432916.728579:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787432916.728589:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812839424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432916.728638:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432916.728722:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812839424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432916.728730:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787432916.728773:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812839424:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787432917.109970:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787432917.432822:0:5889:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1437e822-c48b-4d58-8b99-8f0f7949835b 00000001:00100000:1.0:1787432917.432843:0:5889:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3518b7f2-8018-4ccd-b342-b1564cc6e0dc 00010000:00010000:3.0:1787432918.136768:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787432918.968786:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787432919.157954:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787432919.522033:0:16325:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1787432919.962081:0:6749:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3518b7f2-8018-4ccd-b342-b1564cc6e0dc 00010000:00010000:1.0:1787432920.188533:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432921.020225:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432921.020271:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432921.020292:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432921.020319:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432921.020336:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432921.020352:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432921.020387:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432921.020427:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791874048 00000100:00100000:3.0:1787432921.020444:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791874048 00000100:00100000:3.0:1787432921.020519:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791874432 00000100:00100000:3.0:1787432921.020522:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791874432 00000100:00100000:3.0:1787432921.020551:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:3.0:1787432921.020562:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+6:2377:x1874258791874048:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432921.020695:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+6:2377:x1874258791874048:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 134us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432921.020704:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:3.0:1787432921.020723:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:3.0:1787432921.020729:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+6:2377:x1874258791874432:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432921.020749:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+6:2377:x1874258791874432:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 21us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432921.020755:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:3.0:1787432921.020770:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791874304 00000100:00100000:3.0:1787432921.020773:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791874304 00000100:00100000:3.0:1787432921.020793:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791874560 00000100:00100000:3.0:1787432921.020795:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791874560 00000100:00100000:3.0:1787432921.020806:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791874176 00000100:00100000:3.0:1787432921.020808:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791874176 00000100:00100000:3.0:1787432921.020818:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791874688 00000100:00100000:3.0:1787432921.020819:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791874688 00000100:00100000:3.0:1787432921.020832:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:3.0:1787432921.020837:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+5:2377:x1874258791874304:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432921.020859:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+5:2377:x1874258791874304:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 22us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432921.020865:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:3.0:1787432921.020874:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:3.0:1787432921.020879:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+5:2377:x1874258791874560:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432921.020896:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+5:2377:x1874258791874560:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 17us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432921.020912:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:3.0:1787432921.020921:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:3.0:1787432921.020927:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+5:2377:x1874258791874176:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432921.020946:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+5:2377:x1874258791874176:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 20us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432921.020952:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:3.0:1787432921.020959:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:3.0:1787432921.020965:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+5:2377:x1874258791874688:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432921.020981:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+5:2377:x1874258791874688:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 17us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432921.020987:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:3.0:1787432921.021008:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791873920 00000100:00100000:3.0:1787432921.021012:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791873920 00000100:00100000:3.0:1787432921.021032:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 107 00000100:00100000:3.0:1787432921.021037:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b90974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+13:2377:x1874258791873920:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432921.021058:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b90974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+13:2377:x1874258791873920:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 21us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432921.021064:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 107 00000100:00080000:0.0:1787432921.023684:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787432921.023701:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787432921.023707:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787432921.206674:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432921.336977:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d00b432-f54a-428d-8e42-8523236fbac8:3332:1874258812839552:0@lo:400:kworker.0 00000100:00100000:1.0:1787432921.337085:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432921.337144:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3332:1874258812840064:0@lo:400:kworker.0 00000100:00100000:1.0:1787432921.337177:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432921.337206:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787432921.337211:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812839680:0@lo:400:kworker.0 00000100:00100000:1.0:1787432921.337235:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432921.337253:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812840192:0@lo:400:kworker.0 00000100:00100000:1.0:1787432921.337276:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432921.337303:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812839808:0@lo:400:kworker.0 00000100:00100000:1.0:1787432921.337326:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432921.337345:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787432921.337350:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935a8705fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874258812839936:0@lo:400:kworker.0 00000100:00100000:2.0:1787432921.337526:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812840064 00000100:00100000:2.0:1787432921.337536:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812840064 00000100:00100000:2.0:1787432921.337605:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812840192 00000100:00100000:2.0:1787432921.337608:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812840192 00000100:00100000:2.0:1787432921.337635:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787432921.337646:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1874258812840064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432921.337743:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3332:x1874258812840064:12345-0@lo:400:kworker.0 Request processed in 99us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432921.337751:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787432921.337771:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787432921.337777:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812840192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432921.337805:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3332:x1874258812840192:12345-0@lo:400:kworker.0 Request processed in 29us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432921.337811:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787432921.337829:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812839680 00000100:00100000:2.0:1787432921.337851:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812839680 00000100:00100000:2.0:1787432921.337882:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812839808 00000100:00100000:2.0:1787432921.337885:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812839808 00000100:00100000:2.0:1787432921.337903:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787432921.337909:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812839680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432921.337941:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812839680:12345-0@lo:400:kworker.0 Request processed in 33us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432921.337947:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787432921.337957:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787432921.337962:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812839808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432921.337988:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3330:x1874258812839808:12345-0@lo:400:kworker.0 Request processed in 26us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432921.337994:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787432921.338012:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787432921.338020:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812840320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432921.338049:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432921.338103:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812840320 00000100:00100000:2.0:1787432921.338106:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812840320 00000100:00100000:2.0:1787432921.338134:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432921.338141:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812840320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432921.338177:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432921.338217:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812840320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432921.338224:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787432921.338280:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812840320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432921.338313:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812839680:0@lo:400:kworker.0 00000100:00100000:2.0:1787432921.338338:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3332:1874258812840192:0@lo:400:kworker.0 00000100:00100000:2.0:1787432921.338349:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3332:1874258812840064:0@lo:400:kworker.0 00000100:00100000:1.0:1787432921.339757:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432921.339835:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3330:1874258812839808:0@lo:400:kworker.0 00000100:00100000:3.0:1787432921.339946:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812839936 00000100:00100000:3.0:1787432921.339954:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812839936 00000100:00100000:3.0:1787432921.340019:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787432921.340030:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874258812839936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432921.340089:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874258812839936:12345-0@lo:400:kworker.0 Request processed in 61us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432921.340116:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787432921.340909:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874258812839936:0@lo:400:kworker.0 00000100:00100000:0.0:1787432921.341077:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812839552 00000100:00100000:0.0:1787432921.341084:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812839552 00000100:00100000:0.0:1787432921.341137:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787432921.341148:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b90975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+19:3332:x1874258812839552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432921.341230:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b90975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+19:3332:x1874258812839552:12345-0@lo:400:kworker.0 Request processed in 84us (4144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432921.341237:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1787432921.341272:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787432921.341290:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787432921.341294:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432921.341319:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935a8705f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d00b432-f54a-428d-8e42-8523236fbac8:3332:1874258812839552:0@lo:400:kworker.0 00000100:00100000:0.0:1787432921.847293:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812840448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432921.847454:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432921.849946:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812840448 00000100:00100000:2.0:1787432921.849966:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812840448 00000100:00100000:2.0:1787432921.850041:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787432921.850055:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812840448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787432921.850108:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432921.850214:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812840448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (2759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432921.850223:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787432921.850293:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812840448:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787432922.237204:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432923.266114:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432924.278271:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787432924.604125:0:16474:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc3b044bc0 20000000:00000080:3.0:1787432924.604151:0:16474:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff935a86850c00 uarg=0000000000000000 20000000:01000000:3.0:1787432924.604202:0:16474:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787432924.604210:0:16474:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787432924.604217:0:16474:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787432924.610074:0:16475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1787432924.610441:0:16474:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787432924.626809:0:16474:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787432924.626975:0:16474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff935b80031800/0xbcb9e331c3f10e7d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432924.627002:0:16474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bc2154e00/0xbcb9e331c3f10b74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10b6d expref: 18 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432924.627010:0:16474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bba8e6400/0xbcb9e331c3f10bc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10bba expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432924.627017:0:16474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bba8e6c00/0xbcb9e331c3f10cfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10cf5 expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432924.627028:0:16474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935b80030000/0xbcb9e331c3f10e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a025fdb expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432924.627036:0:16474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff935bbaa5f800/0xbcb9e331c3f10e53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02603d expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432924.627045:0:16474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff935b80031800/0xbcb9e331c3f10e7d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432924.627107:0:16474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bbaa5f800/0xbcb9e331c3f10e53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a02603d expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432924.627419:0:16474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff935bbaa5f800/0xbcb9e331c3f10e53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a02603d expref: 12 pid: 14347 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432924.627439:0:16474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1874258812840576:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787432924.627640:0:16474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935b80030000/0xbcb9e331c3f10e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a025fdb expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432924.627649:0:16474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff935b80030000/0xbcb9e331c3f10e1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025fdb expref: 12 pid: 14349 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432924.627693:0:16474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1874258812840704:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787432924.627729:0:16474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bba8e6c00/0xbcb9e331c3f10cfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f10cf5 expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432924.627737:0:16474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff935bba8e6c00/0xbcb9e331c3f10cfc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f10cf5 expref: 18 pid: 14350 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432924.627746:0:16474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1874258812840832:0@lo:104: 00000100:00100000:3.0:1787432924.627793:0:16474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787432924.627838:0:16474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bba8e6400/0xbcb9e331c3f10bc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f10bba expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432924.627846:0:16474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff935bba8e6400/0xbcb9e331c3f10bc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f10bba expref: 18 pid: 14347 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432924.627854:0:16474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1874258812840960:0@lo:104: 00000100:00100000:3.0:1787432924.627876:0:16474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787432924.627924:0:16474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff935bc2154e00/0xbcb9e331c3f10b74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbcb9e331c3f10b6d expref: 18 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432924.627932:0:16474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff935bc2154e00/0xbcb9e331c3f10b74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbcb9e331c3f10b6d expref: 18 pid: 14349 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432924.627940:0:16474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1874258812841088:0@lo:104: 00000100:00100000:3.0:1787432924.627968:0:16474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432924.627979:0:16474:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b875ee540 going to sleep for 11 seconds 00000100:00100000:0.0:1787432924.628086:0:14339:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787432924.628104:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812840832 00000100:00100000:0.0:1787432924.628112:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812840832 00000100:00100000:0.0:1787432924.628173:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812840960 00000100:00100000:0.0:1787432924.628176:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812840960 00000100:00100000:0.0:1787432924.628188:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812841088 00000100:00100000:0.0:1787432924.628191:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812841088 00000100:00100000:0.0:1787432924.628205:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432924.628214:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d00b432-f54a-428d-8e42-8523236fbac8+5:16474:x1874258812840832:12345-0@lo:104: 00010000:00010000:0.0:1787432924.628230:0:14339:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f10cf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f10cfc expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.628312:0:14339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787432924.628319:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d00b432-f54a-428d-8e42-8523236fbac8+5:16474:x1874258812840832:12345-0@lo:104: Request processed in 106us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432924.628326:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432924.628348:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787432924.628353:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d00b432-f54a-428d-8e42-8523236fbac8+4:16474:x1874258812840960:12345-0@lo:104: 00010000:00010000:0.0:1787432924.628362:0:14339:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f600/0xbcb9e331c3f10bba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f10bc1 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.628406:0:14339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787432924.628419:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d00b432-f54a-428d-8e42-8523236fbac8+4:16474:x1874258812840960:12345-0@lo:104: Request processed in 66us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432924.628426:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787432924.628440:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787432924.628446:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb4d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d00b432-f54a-428d-8e42-8523236fbac8+3:16474:x1874258812841088:12345-0@lo:104: 00010000:00010000:0.0:1787432924.628454:0:14339:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff935bba8e6a00/0xbcb9e331c3f10b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f10b74 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.628488:0:14339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787432924.628493:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb4d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d00b432-f54a-428d-8e42-8523236fbac8+3:16474:x1874258812841088:12345-0@lo:104: Request processed in 48us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432924.628498:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787432924.628543:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787432924.628551:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f10cf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f10cfc expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.628557:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031c00 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:0.0:1787432924.628562:0:14343:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f10cf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f10cfc expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.628571:0:14343:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f10cf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f10cfc expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432924.628579:0:14343:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f10cf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f10cfc expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432924.628586:0:14343:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787432924.628621:0:14343:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f10cf5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10cfc expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.628639:0:14343:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432924.628701:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f10cf5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10cfc expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.628710:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935b80031c00/0xbcb9e331c3f10cf5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10cfc expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.628728:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787432924.628732:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f600/0xbcb9e331c3f10bba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f10bc1 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.628738:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f600 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:0.0:1787432924.628741:0:14343:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f600/0xbcb9e331c3f10bba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f10bc1 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.628748:0:14343:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f600/0xbcb9e331c3f10bba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f10bc1 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432924.628754:0:14343:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f600/0xbcb9e331c3f10bba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f10bc1 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432924.628776:0:14343:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787432924.628792:0:14343:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f600/0xbcb9e331c3f10bba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10bc1 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.628797:0:14343:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432924.628804:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f600/0xbcb9e331c3f10bba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10bc1 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.628810:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bbaa5f600/0xbcb9e331c3f10bba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10bc1 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.628826:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787432924.628830:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff935bba8e6a00/0xbcb9e331c3f10b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbcb9e331c3f10b74 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.628835:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6a00 already unused, calling callback (ffffffffc1d6fc20) 10000000:00010000:0.0:1787432924.628838:0:14343:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff935bba8e6a00/0xbcb9e331c3f10b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbcb9e331c3f10b74 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.628845:0:14343:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff935bba8e6a00/0xbcb9e331c3f10b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbcb9e331c3f10b74 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787432924.628850:0:14343:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff935bba8e6a00/0xbcb9e331c3f10b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbcb9e331c3f10b74 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787432924.628855:0:14343:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787432924.628868:0:14343:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff935bba8e6a00/0xbcb9e331c3f10b6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10b74 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.628875:0:14343:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787432924.628894:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff935bba8e6a00/0xbcb9e331c3f10b6d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10b74 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.628901:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff935bba8e6a00/0xbcb9e331c3f10b6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbcb9e331c3f10b74 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.628918:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432924.628920:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432924.628922:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432924.628930:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787432924.628943:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432924.628970:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d00b432-f54a-428d-8e42-8523236fbac8:3332:1874258812841216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432924.629010:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432924.629050:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432924.629055:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d00b432-f54a-428d-8e42-8523236fbac8:3332:1874258812841344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432924.629075:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432924.629203:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d00b432-f54a-428d-8e42-8523236fbac8:3330:1874258812841472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432924.629237:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432924.629273:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812841216 00000100:00100000:0.0:1787432924.629278:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812841216 00010000:00010000:0.0:1787432924.629303:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bba8e6c00/0xbcb9e331c3f10cfc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f10cf5 expref: 19 pid: 14350 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432924.629320:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812841344 00000100:00100000:0.0:1787432924.629323:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812841344 00010000:00010000:0.0:1787432924.629334:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bba8e6400/0xbcb9e331c3f10bc1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f10bba expref: 20 pid: 14347 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432924.629342:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812841472 00000100:00100000:0.0:1787432924.629345:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812841472 00010000:00010000:0.0:1787432924.629355:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bc2154e00/0xbcb9e331c3f10b74 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f10b6d expref: 21 pid: 14349 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432924.629366:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432924.629389:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d00b432-f54a-428d-8e42-8523236fbac8+21:3332:x1874258812841216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432924.629401:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432924.629407:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bba8e6c00/0xbcb9e331c3f10cfc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f10cf5 expref: 21 pid: 14350 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.629429:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bba8e6c00/0xbcb9e331c3f10cfc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f10cf5 expref: 21 pid: 14350 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.629451:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432924.629485:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d00b432-f54a-428d-8e42-8523236fbac8+21:3332:x1874258812841216:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432924.629492:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787432924.629510:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787432924.629517:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d00b432-f54a-428d-8e42-8523236fbac8+20:3332:x1874258812841344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432924.629525:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432924.629529:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bba8e6400/0xbcb9e331c3f10bc1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f10bba expref: 20 pid: 14347 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.629536:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bba8e6400/0xbcb9e331c3f10bc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f10bba expref: 20 pid: 14347 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.629546:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432924.629566:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d00b432-f54a-428d-8e42-8523236fbac8+20:3332:x1874258812841344:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432924.629572:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787432924.629583:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787432924.629589:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8e3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d00b432-f54a-428d-8e42-8523236fbac8+19:3330:x1874258812841472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787432924.629595:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432924.629600:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bc2154e00/0xbcb9e331c3f10b74 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbcb9e331c3f10b6d expref: 19 pid: 14349 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.629607:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bc2154e00/0xbcb9e331c3f10b74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbcb9e331c3f10b6d expref: 19 pid: 14349 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.629624:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432924.629651:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8e3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d00b432-f54a-428d-8e42-8523236fbac8+19:3330:x1874258812841472:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432924.629683:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787432924.629750:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d00b432-f54a-428d-8e42-8523236fbac8:3330:1874258812841472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432924.629779:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d00b432-f54a-428d-8e42-8523236fbac8:3332:1874258812841344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787432924.629786:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d00b432-f54a-428d-8e42-8523236fbac8:3332:1874258812841216:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787432924.632099:0:16474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bba8e6c00/0xbcb9e331c3f10cfc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f10cf5 expref: 18 pid: 14350 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432924.632124:0:16474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1874258812840832:0@lo:104: 00010000:00010000:3.0:1787432924.632149:0:16474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bba8e6400/0xbcb9e331c3f10bc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f10bba expref: 17 pid: 14347 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432924.632157:0:16474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1874258812840960:0@lo:104: 00010000:00010000:3.0:1787432924.632170:0:16474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bc2154e00/0xbcb9e331c3f10b74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbcb9e331c3f10b6d expref: 16 pid: 14349 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432924.632180:0:16474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1874258812841088:0@lo:104: 00000100:00100000:0.0:1787432924.644068:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432924.644181:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432924.644238:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791874816 00000100:00100000:0.0:1787432924.644249:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791874816 00010000:00010000:0.0:1787432924.644302:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935bbaa5f800/0xbcb9e331c3f10e53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a02603d expref: 13 pid: 14347 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432924.644340:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791874944 00000100:00100000:0.0:1787432924.644344:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791874944 00010000:00010000:0.0:1787432924.644357:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff935b80030000/0xbcb9e331c3f10e1b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025fdb expref: 14 pid: 14349 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432924.644386:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:0.0:1787432924.644397:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d50bdb12-e88c-4003-a207-6f70712558c4+14:2375:x1874258791874816:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432924.644416:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432924.644423:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935bbaa5f800/0xbcb9e331c3f10e53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a02603d expref: 14 pid: 14347 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.644438:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935bbaa5f800/0xbcb9e331c3f10e53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a02603d expref: 14 pid: 14347 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.644478:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432924.644547:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d50bdb12-e88c-4003-a207-6f70712558c4+14:2375:x1874258791874816:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 152us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432924.644554:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:0.0:1787432924.644577:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:0.0:1787432924.644583:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d50bdb12-e88c-4003-a207-6f70712558c4+13:2378:x1874258791874944:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432924.644594:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432924.644598:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff935b80030000/0xbcb9e331c3f10e1b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025fdb expref: 13 pid: 14349 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.644608:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff935b80030000/0xbcb9e331c3f10e1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025fdb expref: 13 pid: 14349 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.644621:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff935b80031800/0xbcb9e331c3f10e7d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.644629:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935b80031800/0xbcb9e331c3f10e7d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.644647:0:14341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935b80031800/0xbcb9e331c3f10e7d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.644691:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff935b80031800/0xbcb9e331c3f10e7d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.644699:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff935b80031800/0xbcb9e331c3f10e7d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.644707:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff935b80031800/0xbcb9e331c3f10e7d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.644721:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031800 already unused, calling callback (ffffffffc1752230) 00010000:00010000:0.0:1787432924.644727:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff935b80031800/0xbcb9e331c3f10e7d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.644735:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff935b80031800/0xbcb9e331c3f10e7d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.644746:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff935b80031800/0xbcb9e331c3f10e7d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432924.644757:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432924.644779:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d50bdb12-e88c-4003-a207-6f70712558c4+13:2378:x1874258791874944:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 196us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432924.644786:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00010000:00010000:3.0:1787432924.646162:0:16474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935bbaa5f800/0xbcb9e331c3f10e53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a02603d expref: 12 pid: 14347 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432924.646191:0:16474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa50e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1874258812840576:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787432924.646211:0:16474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935b80030000/0xbcb9e331c3f10e1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a025fdb expref: 11 pid: 14349 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432924.646221:0:16474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1874258812840704:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787432924.646281:0:16474:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff935b80031800/0xbcb9e331c3f10e7d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432924.646306:0:16474:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff935b80031800/0xbcb9e331c3f10e7d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432924.646312:0:16474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff935b80031800/0xbcb9e331c3f10e7d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432924.646318:0:16474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff935b80031800/0xbcb9e331c3f10e7d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432925.303825:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787432925.685736:0:14353:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787432925.685747:0:14353:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff935bba8c7800 from 10 10000000:01000000:0.0:1787432925.685755:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787432925.685820:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba1cfc00/0xbcb9e331c3f10e84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432925.685834:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935bba1cfc00/0xbcb9e331c3f10e84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432925.685847:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935bba1cfc00/0xbcb9e331c3f10e84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432925.685880:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812841600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787432925.685971:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432925.686063:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91a67b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432925.686156:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812841600 00000100:00100000:1.0:1787432925.686168:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812841600 00000100:00100000:1.0:1787432925.686248:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787432925.686259:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b90976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+16:14353:x1874258812841600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787432925.686738:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432925.686763:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba8e7e00/0xbcb9e331c3f10e8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f10e84 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432925.686796:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba8e7e00/0xbcb9e331c3f10e8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f10e84 expref: 17 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432925.686809:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba8e7e00/0xbcb9e331c3f10e8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10e84 expref: 17 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432925.686820:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e7e00, rc 0) 00000100:00100000:1.0:1787432925.686892:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b90976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+17:14353:x1874258812841600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 633us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432925.686901:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787432925.687039:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812841600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432925.687058:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935bba1cfc00/0xbcb9e331c3f10e84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10e8b expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432925.687069:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935bba1cfc00/0xbcb9e331c3f10e84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f10e8b expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432925.687156:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812841728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432925.687193:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432925.687226:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91a67b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432925.687434:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812841728 00000100:00100000:1.0:1787432925.687442:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812841728 00000100:00100000:1.0:1787432925.687554:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787432925.687565:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba41a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+17:14353:x1874258812841728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432925.687907:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba41a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+17:14353:x1874258812841728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 343us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432925.687915:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787432925.687961:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812841728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432925.688004:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba888e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812841856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432925.688052:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432925.688071:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b874e8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787432925.688086:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812841856 00000100:00100000:1.0:1787432925.688090:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812841856 00000100:00100000:1.0:1787432925.688122:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787432925.688128:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba41b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+17:14353:x1874258812841856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432925.691527:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba41b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+17:14353:x1874258812841856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3384us (3460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432925.691547:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787432925.692251:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba888e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812841856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787432925.705355:0:16499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787432925.705470:0:14353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787432925.705507:0:14353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787432925.705522:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935bba1cfc00/0xbcb9e331c3f10e84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10e8b expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432925.705534:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935bba1cfc00/0xbcb9e331c3f10e84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10e8b expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432925.705547:0:14353:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787432925.705551:0:14353:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff935b87de8800 from 10 10000000:01000000:3.0:1787432925.705554:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787432925.705603:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031800/0xbcb9e331c3f10e92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432925.705612:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935b80031800/0xbcb9e331c3f10e92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432925.705650:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935b80031800/0xbcb9e331c3f10e92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432925.705722:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812841984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787432925.705816:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432925.705872:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b875ee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432925.710792:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812841984 00000100:00100000:0.0:1787432925.710814:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812841984 00000100:00100000:0.0:1787432925.710892:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787432925.710905:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba418850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+17:14353:x1874258812841984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432925.710930:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432925.710957:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba1cf600/0xbcb9e331c3f10e99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f10e92 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432925.710995:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba1cf600/0xbcb9e331c3f10e99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f10e92 expref: 18 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432925.711009:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba1cf600/0xbcb9e331c3f10e99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10e92 expref: 18 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432925.711020:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cf600, rc 0) 00000100:00100000:0.0:1787432925.711127:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba418850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+18:14353:x1874258812841984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (5310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432925.711134:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787432925.711323:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812841984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432925.711346:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935b80031800/0xbcb9e331c3f10e92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10e99 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432925.711359:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935b80031800/0xbcb9e331c3f10e92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f10e99 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432925.711589:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812842112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432925.711634:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432925.711700:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b875ee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432925.711719:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812842112 00000100:00100000:3.0:1787432925.711724:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812842112 00000100:00100000:3.0:1787432925.711759:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787432925.711767:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba419050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+18:14353:x1874258812842112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432925.712096:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba419050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+18:14353:x1874258812842112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 328us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432925.712103:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787432925.712142:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812842112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432925.712178:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812842240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432925.712227:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432925.712242:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b875ee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432925.712254:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812842240 00000100:00100000:3.0:1787432925.712257:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812842240 00000100:00100000:1.0:1787432925.712423:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787432925.712435:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba419450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+18:14353:x1874258812842240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787432925.712634:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba419450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+18:14353:x1874258812842240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432925.712642:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787432925.712930:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812842240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787432925.720170:0:16500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787432925.720717:0:14353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787432925.720745:0:14353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787432925.720760:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80031800/0xbcb9e331c3f10e92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10e99 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432925.720774:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935b80031800/0xbcb9e331c3f10e92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10e99 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787432925.720787:0:14353:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787432925.720790:0:14353:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff935bbb47d000 from 10 10000000:01000000:3.0:1787432925.720793:0:14353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787432925.720844:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f10ea0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432925.720852:0:14353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f10ea0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432925.720866:0:14353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f10ea0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432925.720899:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812842368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787432925.720993:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432925.721050:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b875ee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432925.722954:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812842368 00000100:00100000:0.0:1787432925.722972:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812842368 00000100:00100000:0.0:1787432925.723052:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787432925.723065:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba419850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+18:14353:x1874258812842368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432925.723086:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432925.723107:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba1ce400/0xbcb9e331c3f10ea7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcb9e331c3f10ea0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432925.723140:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba1ce400/0xbcb9e331c3f10ea7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbcb9e331c3f10ea0 expref: 19 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432925.723152:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba1ce400/0xbcb9e331c3f10ea7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbcb9e331c3f10ea0 expref: 19 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432925.723162:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1ce400, rc 0) 00000100:00100000:0.0:1787432925.723256:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba419850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d00b432-f54a-428d-8e42-8523236fbac8+19:14353:x1874258812842368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (2262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432925.723264:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787432925.724742:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812842368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787432925.724798:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f10ea0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10ea7 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432925.724811:0:14353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f10ea0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbcb9e331c3f10ea7 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432925.724914:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812842496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432925.724984:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432925.725033:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b875ee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432925.726426:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812842496 00000100:00100000:0.0:1787432925.726442:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812842496 00000100:00100000:0.0:1787432925.726617:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787432925.726630:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba418050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+19:14353:x1874258812842496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787432925.727043:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba418050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+19:14353:x1874258812842496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 414us (2056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432925.727052:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787432925.728640:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812842496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432925.728738:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812842624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432925.728824:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432925.728874:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b875ee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787432925.728913:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812842624 00000100:00100000:3.0:1787432925.728921:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812842624 00000100:00100000:3.0:1787432925.728976:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787432925.728987:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba419c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+19:14353:x1874258812842624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432925.732133:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba419c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+19:14353:x1874258812842624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3132us (3293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432925.732153:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787432925.733556:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d00b432-f54a-428d-8e42-8523236fbac8:14353:1874258812842624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787432925.754687:0:16502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787432925.766081:0:14353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787432925.766110:0:14353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787432925.766121:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f10ea0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10ea7 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432925.766136:0:14353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff935b80030000/0xbcb9e331c3f10ea0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbcb9e331c3f10ea7 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432925.936631:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432925.937457:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791875072 00000100:00100000:2.0:1787432925.937467:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791875072 00000100:00100000:2.0:1787432925.937521:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 118 00000100:00100000:2.0:1787432925.937531:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba41a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+11:13794:x1874258791875072:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787432925.937546:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432925.937593:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f10eae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a02606e expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432925.937620:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f10eae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02606e expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432925.937632:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bbaa5ea00/0xbcb9e331c3f10eae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02606e expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432925.937641:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5ea00, rc 0) 00000100:00100000:2.0:1787432925.937721:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba41a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+12:13794:x1874258791875072:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 191us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432925.937728:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 118 00000100:00100000:0.0:1787432925.960066:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432925.960178:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791875200 00000100:00100000:3.0:1787432925.960189:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791875200 00000100:00100000:3.0:1787432925.960471:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 119 00000100:00100000:3.0:1787432925.960482:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba418c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+12:13794:x1874258791875200:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787432925.960780:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba418c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+12:13794:x1874258791875200:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 299us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432925.960793:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 119 00000100:00100000:3.0:1787432925.976583:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432925.976624:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791875328 00000100:00100000:3.0:1787432925.976633:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791875328 00000100:00100000:3.0:1787432925.976704:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 120 00000100:00100000:3.0:1787432925.976714:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba41ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+12:13794:x1874258791875328:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787432925.976926:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba41ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+12:13794:x1874258791875328:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 212us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432925.976934:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 120 00000100:00100000:3.0:1787432925.982537:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432925.994842:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791875456 00000100:00100000:0.0:1787432925.994857:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791875456 00000100:00100000:0.0:1787432925.994918:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 121 00000100:00100000:0.0:1787432925.994928:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba41a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+12:13794:x1874258791875456:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787432925.994955:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432925.994981:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff935bba1cf000/0xbcb9e331c3f10eb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x93816182a026075 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432925.995009:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff935bba1cf000/0xbcb9e331c3f10eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026075 expref: 13 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432925.995021:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff935bba1cf000/0xbcb9e331c3f10eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026075 expref: 13 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432925.995030:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cf000, rc 0) 00000100:00100000:0.0:1787432925.995091:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba41a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d50bdb12-e88c-4003-a207-6f70712558c4+13:13794:x1874258791875456:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 164us (12564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432925.995097:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 121 00000100:00100000:1.0:1787432926.011427:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432926.011537:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791875584 00000100:00100000:0.0:1787432926.011547:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791875584 00000100:00100000:1.0:1787432926.011722:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 122 00000100:00100000:1.0:1787432926.011736:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba418450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+13:13794:x1874258791875584:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787432926.012011:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba418450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+13:13794:x1874258791875584:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 278us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432926.012019:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 122 00000100:00100000:0.0:1787432926.016884:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432926.016928:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791875712 00000100:00100000:0.0:1787432926.016937:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791875712 00000100:00100000:0.0:1787432926.016988:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 123 00000100:00100000:0.0:1787432926.016998:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba41b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+13:13794:x1874258791875712:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787432926.017210:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba41b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+13:13794:x1874258791875712:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 213us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432926.017218:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 123 00000100:00100000:0.0:1787432926.134417:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432926.134463:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432926.134531:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432926.134554:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432926.134574:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432926.134599:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432926.134622:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791876224 00000100:00100000:0.0:1787432926.134632:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791876224 00000100:00100000:0.0:1787432926.134725:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791875840 00000100:00100000:0.0:1787432926.134728:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791875840 00000100:00100000:0.0:1787432926.134757:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:0.0:1787432926.134766:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+6:2377:x1874258791876224:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432926.134851:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+6:2377:x1874258791876224:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 85us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432926.134860:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:0.0:1787432926.134882:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:0.0:1787432926.134888:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+6:2377:x1874258791875840:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432926.134913:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+6:2377:x1874258791875840:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 25us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432926.134920:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:0.0:1787432926.134942:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791875968 00000100:00100000:0.0:1787432926.134946:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791875968 00000100:00100000:0.0:1787432926.134965:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791876480 00000100:00100000:0.0:1787432926.134968:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791876480 00000100:00100000:0.0:1787432926.134981:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791876096 00000100:00100000:0.0:1787432926.134984:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791876096 00000100:00100000:0.0:1787432926.134995:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791876352 00000100:00100000:0.0:1787432926.134998:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791876352 00000100:00100000:0.0:1787432926.135026:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:0.0:1787432926.135033:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+5:2377:x1874258791875968:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432926.135059:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+5:2377:x1874258791875968:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 27us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432926.135065:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:0.0:1787432926.135079:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:0.0:1787432926.135085:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+5:2377:x1874258791876480:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432926.135106:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+5:2377:x1874258791876480:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 22us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432926.135112:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:0.0:1787432926.135122:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:0.0:1787432926.135127:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+5:2377:x1874258791876096:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432926.135148:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+5:2377:x1874258791876096:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 20us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432926.135154:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:0.0:1787432926.135165:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:0.0:1787432926.135171:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+5:2377:x1874258791876352:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432926.135191:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+5:2377:x1874258791876352:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 20us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432926.135197:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00080000:0.0:1787432926.135216:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787432926.135220:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787432926.135223:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787432926.325739:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787432926.458597:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812842752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432926.458671:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432926.458754:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812842752 00000100:00100000:2.0:1787432926.458762:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812842752 00000100:00100000:2.0:1787432926.458820:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787432926.458827:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812842752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787432926.458859:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787432926.458905:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812842752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432926.458912:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787432926.458932:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432926.458966:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812842752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432926.461842:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812843008:0@lo:400:kworker.0 00000100:00100000:2.0:1787432926.461897:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432926.461942:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787432926.461946:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d00b432-f54a-428d-8e42-8523236fbac8:3333:1874258812842880:0@lo:400:kworker.0 00000100:00100000:2.0:1787432926.461969:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432926.461996:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3333:1874258812843392:0@lo:400:kworker.0 00000100:00100000:2.0:1787432926.462020:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432926.462046:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812842880 00000100:00100000:2.0:1787432926.462052:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812842880 00000100:00100000:2.0:1787432926.462083:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787432926.462089:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba41bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+19:3333:x1874258812842880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432926.462121:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba41bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d00b432-f54a-428d-8e42-8523236fbac8+19:3333:x1874258812842880:12345-0@lo:400:kworker.0 Request processed in 32us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432926.462126:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787432926.462148:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812843392 00000100:00100000:2.0:1787432926.462150:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812843392 00000100:00100000:2.0:1787432926.462173:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787432926.462177:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1874258812843392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432926.462196:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3333:x1874258812843392:12345-0@lo:400:kworker.0 Request processed in 19us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432926.462200:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787432926.462213:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874258812843136:0@lo:400:kworker.0 00000100:00100000:2.0:1787432926.462228:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432926.462240:0:3330:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787432926.462243:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812843264:0@lo:400:kworker.0 00000100:00100000:2.0:1787432926.462254:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432926.462269:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812843136 00000100:00100000:2.0:1787432926.462271:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812843136 00000100:00100000:2.0:1787432926.462282:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812843264 00000100:00100000:2.0:1787432926.462289:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812843264 00000100:00100000:2.0:1787432926.462303:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787432926.462306:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874258812843136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432926.462328:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3330:x1874258812843136:12345-0@lo:400:kworker.0 Request processed in 21us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432926.462331:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787432926.462339:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787432926.462344:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812843264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432926.462379:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812843264:12345-0@lo:400:kworker.0 Request processed in 35us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432926.462385:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787432926.462406:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432926.462433:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812843264:0@lo:400:kworker.0 00000100:00100000:2.0:1787432926.462443:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3330:1874258812843136:0@lo:400:kworker.0 00000100:00100000:2.0:1787432926.462472:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d00b432-f54a-428d-8e42-8523236fbac8:3333:1874258812842880:0@lo:400:kworker.0 00000100:00100000:2.0:1787432926.462478:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3333:1874258812843392:0@lo:400:kworker.0 00000100:00100000:3.0:1787432926.462523:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812843008 00000100:00100000:3.0:1787432926.462528:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812843008 00000100:00100000:3.0:1787432926.462568:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787432926.462575:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812843008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787432926.462615:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812843008:12345-0@lo:400:kworker.0 Request processed in 40us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432926.462621:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787432926.462644:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812843008:0@lo:400:kworker.0 00000100:00080000:2.0:1787432926.462699:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787432926.966855:0:3332:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787432926.966882:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812843520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432926.966968:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432926.967051:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812843520 00000100:00100000:1.0:1787432926.967061:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812843520 00000100:00100000:1.0:1787432926.967121:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787432926.967135:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812843520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432926.967175:0:15044:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432926.967239:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812843520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432926.967257:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787432926.967498:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812843520:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787432927.349826:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787432928.190651:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787432928.373839:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432928.758852:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432928.759024:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791876608 00000100:00100000:2.0:1787432928.759047:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791876608 00000100:00100000:2.0:1787432928.759135:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:2.0:1787432928.759148:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+6:14453:x1874258791876608:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787432928.759173:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432928.759199:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10ebc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a02607c expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.759306:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10ec3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.759319:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10ec3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.759352:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10ec3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.759368:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10eca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.759376:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10eca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.759383:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10eca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787432928.760409:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787432928.762239:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10ed1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.762263:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.762275:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432928.762412:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787432928.762417:0:14355:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787432928.763752:0:14355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.763786:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10ec3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.763793:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10ec3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.763800:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10ec3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.763806:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432928.763811:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10ec3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.763819:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10ec3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.763840:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9826d200) 00010000:00010000:2.0:1787432928.763843:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432928.763848:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10ec3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.763853:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10ec3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.763867:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10eca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.763872:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10eca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.766410:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10eca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.766441:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432928.766446:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10eca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.766455:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10eca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.766473:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff935b952e8d00) 00010000:00010000:2.0:1787432928.766476:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432928.766481:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10eca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.766488:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10eca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.767679:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10ebc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02607c expref: 8 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.767698:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e200/0xbcb9e331c3f10ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02607c expref: 7 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.767707:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff935b952e8e00) 00010000:00010000:2.0:1787432928.767710:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787432928.767713:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e200, rc 0) 00000100:00100000:2.0:1787432928.767790:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+7:14453:x1874258791876608:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 8644us (8946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432928.767800:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:0.0:1787432928.800917:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432928.801072:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791876864 00000100:00100000:2.0:1787432928.801093:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791876864 00000100:00100000:2.0:1787432928.801163:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:2.0:1787432928.801175:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+7:14453:x1874258791876864:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787432928.801197:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432928.801220:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10ed8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a026083 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.801299:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10edf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.801314:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10edf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.801327:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10edf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.801353:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10ee6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.801361:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.801368:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.802131:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ee00/0xbcb9e331c3f10eed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.802143:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ee00/0xbcb9e331c3f10eed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.802152:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ee00/0xbcb9e331c3f10eed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432928.802170:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787432928.802453:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10edf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.802462:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10edf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.802468:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10edf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.802474:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432928.802478:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10edf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.802485:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10edf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.802512:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff935b952e8e00) 00010000:00010000:2.0:1787432928.802515:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432928.802520:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10edf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.802526:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10edf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.802541:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.802547:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.802563:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.802567:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432928.802570:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.802576:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10ee6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.802583:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff935b952e8d00) 00010000:00010000:2.0:1787432928.802586:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432928.802589:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10ee6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.802594:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10ee6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.804874:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f10ed8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026083 expref: 10 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.804969:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ee00/0xbcb9e331c3f10eed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026083 expref: 9 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.804978:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff935b952e8700) 00010000:00010000:1.0:1787432928.804981:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432928.804985:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5ee00, rc 0) 00000100:00100000:1.0:1787432928.805068:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+9:14453:x1874258791876864:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 3894us (4162us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787432928.805078:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:0.0:1787432928.836041:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432928.836257:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791876992 00000100:00100000:3.0:1787432928.836269:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791876992 00000100:00100000:3.0:1787432928.836376:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:3.0:1787432928.836387:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+9:14453:x1874258791876992:12345-192.168.202.15@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787432928.836493:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+9:14453:x1874258791876992:12345-192.168.202.15@tcp:59:lhsmtool_posix.0 Request processed in 107us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432928.836517:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:0.0:1787432928.867408:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432928.867588:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791877120 00000100:00100000:2.0:1787432928.867601:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791877120 00000100:00100000:2.0:1787432928.867715:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:2.0:1787432928.867728:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+9:14459:x1874258791877120:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787432928.867761:0:15772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432928.867795:0:15772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10efb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a02608a expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.867886:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f02 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.867925:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.867939:0:15772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.867957:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10f09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.867964:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10f09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.867970:0:15772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10f09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.868298:0:15772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.868308:0:15772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f02 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.868315:0:15772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.868321:0:15772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432928.868326:0:15772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.868346:0:15772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f02 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.868364:0:15772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9826d200) 00010000:00010000:2.0:1787432928.868374:0:15772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432928.868380:0:15772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.868387:0:15772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.868403:0:15772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10f09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.868409:0:15772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10f09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.868415:0:15772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10f09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.868421:0:15772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432928.868424:0:15772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10f09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.868431:0:15772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10f09 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.868438:0:15772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff935b952e8d00) 00010000:00010000:2.0:1787432928.868441:0:15772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432928.868443:0:15772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10f09 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.868449:0:15772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10f09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.868494:0:15772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10efb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02608a expref: 10 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.868513:0:15772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9826d200) 00010000:00010000:2.0:1787432928.868515:0:15772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432928.868520:0:15772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10efb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02608a expref: 10 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.868529:0:15772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e000, rc 0) 00000100:00100000:2.0:1787432928.868616:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+9:14459:x1874258791877120:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 890us (1228us total) trans 0 rc 301/301 00000100:00100000:2.0:1787432928.868625:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:0.0:1787432928.884525:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432928.890030:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791877248 00000100:00100000:1.0:1787432928.890065:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791877248 00000100:00100000:1.0:1787432928.890154:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:1.0:1787432928.890167:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1437e822-c48b-4d58-8b99-8f0f7949835b+9:14459:x1874258791877248:12345-192.168.202.15@tcp:700:lfs.0 00000100:00100000:1.0:1787432928.890300:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1437e822-c48b-4d58-8b99-8f0f7949835b+9:14459:x1874258791877248:12345-192.168.202.15@tcp:700:lfs.0 Request processed in 135us (5793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432928.890309:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:0.0:1787432928.902003:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432928.902467:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791877504 00000100:00100000:3.0:1787432928.902484:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791877504 00000100:00100000:3.0:1787432928.902580:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:3.0:1787432928.902594:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+9:14459:x1874258791877504:12345-192.168.202.15@tcp:36:lfs.0 00010000:00010000:3.0:1787432928.902713:0:14357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432928.902756:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f10e3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026005 expref: 9 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.902788:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9826d200) 00010000:00010000:3.0:1787432928.902794:0:14357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432928.903779:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f10f10 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.903811:0:14357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10e76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026067 expref: 5 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.903822:0:14357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f10f10 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.903875:0:14357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10e76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a026067 expref: 5 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.904523:0:14357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10e76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a026067 expref: 5 pid: 14356 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432928.904546:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14357:1874258812843648:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787432928.905429:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b864bad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787432928.918977:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432928.920115:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791877632 00000100:00100000:1.0:1787432928.920135:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791877632 00010000:00010000:1.0:1787432928.920232:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10e76 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a026067 expref: 6 pid: 14356 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432928.920304:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:1.0:1787432928.920431:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+6:2375:x1874258791877632:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432928.920452:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432928.920461:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10e76 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a026067 expref: 6 pid: 14356 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.920477:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10e76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a026067 expref: 6 pid: 14356 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.920508:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9826d200) 00010000:00010000:1.0:1787432928.920516:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f10f10 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.920527:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f10f10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.920537:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f10f10 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432928.920806:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432928.920897:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+6:2375:x1874258791877632:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 470us (1935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432928.920906:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00080000:0.0:1787432928.921292:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787432928.923451:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f10e76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a026067 expref: 5 pid: 14356 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432928.923484:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14357:1874258812843648:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787432928.923514:0:14357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f10f10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.923525:0:14357:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f10f10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.923531:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f10f10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.923648:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f10f17 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.923726:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f10f17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432928.923739:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f10f17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432928.940859:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787432928.941164:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f10f10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.941181:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f10f10 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.941190:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f10f10 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.941197:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031e00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432928.941202:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f10f10 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.941211:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f10f10 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.941233:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9826d200) 00010000:00010000:2.0:1787432928.941236:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432928.941271:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f10f10 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.941278:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f10f10 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787432928.942149:0:14357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f5c494a reply state 00000000b7b5d149 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f10f17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432928.942167:0:14357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787432928.943279:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+10:14459:x1874258791877504:12345-192.168.202.15@tcp:36:lfs.0 Request processed in 40674us (41286us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787432928.943294:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00010000:00010000:2.0:1787432928.957347:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f10f17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.957373:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f10f17 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.957382:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f10f17 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.957389:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432928.957395:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f10f17 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.957403:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f10f17 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.957424:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff935b9826dd00) 00010000:00010000:2.0:1787432928.957427:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432928.957433:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f10f17 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432928.957457:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f10f17 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432929.144475:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432929.144537:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791877760 00000100:00100000:3.0:1787432929.144548:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791877760 00000100:00100000:3.0:1787432929.144636:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:3.0:1787432929.144647:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+9:14467:x1874258791877760:12345-192.168.202.15@tcp:101:lctl.0 00010000:00010000:3.0:1787432929.144689:0:15772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432929.144708:0:15772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10f1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a026091 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.144779:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f10f25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.144790:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f10f25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.144798:0:15772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f10f25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432929.144858:0:15772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787432929.144861:0:15772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432929.144892:0:15772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f10f25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.144910:0:15772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10f1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026091 expref: 11 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.144925:0:15772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031a00/0xbcb9e331c3f10f25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026091 expref: 10 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.144932:0:15772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9826d400) 00010000:00010000:3.0:1787432929.144934:0:15772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787432929.144936:0:15772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80031a00, rc 0) 00000100:00100000:3.0:1787432929.145045:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+10:14467:x1874258791877760:12345-192.168.202.15@tcp:101:lctl.0 Request processed in 400us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432929.145050:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00000040:00080000:3.0:1787432929.206247:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787432929.211952:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432929.212409:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791877888 00000100:00100000:2.0:1787432929.212424:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791877888 00000100:00100000:2.0:1787432929.212726:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:2.0:1787432929.212741:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+5:14468:x1874258791877888:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787432929.212769:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432929.212797:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10f2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a026098 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.212887:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10f33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.212905:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10f33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.212918:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10f33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432929.213003:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787432929.213008:0:14355:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787432929.213035:0:14355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10f33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.213061:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10f2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026098 expref: 7 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.213082:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f200/0xbcb9e331c3f10f33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026098 expref: 6 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.213110:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9826d400) 00010000:00010000:2.0:1787432929.213114:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787432929.213118:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f200, rc 0) 00000100:00100000:2.0:1787432929.213223:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+6:14468:x1874258791877888:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 486us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432929.213231:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:1.0:1787432929.219835:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432929.220054:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791878016 00000100:00100000:2.0:1787432929.220075:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791878016 00000100:00100000:2.0:1787432929.220165:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:2.0:1787432929.220178:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+6:14468:x1874258791878016:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787432929.220216:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432929.220251:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a02609f expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.220351:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10f41 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.220373:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10f41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.220387:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10f41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.220404:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10f48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.220411:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10f48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.220442:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10f48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.225020:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10f4f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.225046:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10f4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.225061:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10f4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432929.225138:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787432929.225142:0:14355:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787432929.225170:0:14355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10f4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.225187:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10f41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.225194:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10f41 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.225202:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10f41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.225209:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fc00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432929.225213:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10f41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.225221:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10f41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.225255:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9826d400) 00010000:00010000:2.0:1787432929.225259:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432929.225264:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10f41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.225272:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10f41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.225291:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10f48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.225298:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10f48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.225304:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10f48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.225309:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432929.225312:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10f48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.225318:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10f48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.225327:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff935b952e8d00) 00010000:00010000:2.0:1787432929.225339:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432929.225342:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10f48 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.225349:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10f48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.225404:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02609f expref: 8 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.225421:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10f4f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02609f expref: 7 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.225429:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff935b952e8c00) 00010000:00010000:2.0:1787432929.225432:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787432929.225435:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f600, rc 0) 00000100:00100000:2.0:1787432929.225517:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+7:14468:x1874258791878016:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 5341us (5690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432929.225526:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:1.0:1787432929.234717:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432929.234827:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791878272 00000100:00100000:2.0:1787432929.234840:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791878272 00000100:00100000:2.0:1787432929.234905:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:2.0:1787432929.234915:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+7:14468:x1874258791878272:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787432929.234938:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432929.234961:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10f56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a0260a6 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432929.235090:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787432929.235216:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10f56 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260a6 expref: 9 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.235232:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9826d400) 00010000:00010000:2.0:1787432929.235235:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787432929.235254:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10f56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260a6 expref: 9 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.235270:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e000, rc 0) 00000100:00100000:2.0:1787432929.235348:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+8:14468:x1874258791878272:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 434us (642us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787432929.235357:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:0.0:1787432929.242608:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432929.243167:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791878528 00000100:00100000:3.0:1787432929.243197:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791878528 00000100:00100000:3.0:1787432929.243266:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:3.0:1787432929.243281:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+8:14468:x1874258791878528:12345-192.168.202.15@tcp:36:lfs.0 00010000:00010000:3.0:1787432929.243378:0:15772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432929.243418:0:15772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f10f4f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02609f expref: 8 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.243445:0:15772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff935b952e8c00) 00010000:00010000:3.0:1787432929.243458:0:15772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787432929.243496:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10f64 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.243510:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10f64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.243522:0:15772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10f64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432929.243858:0:15772:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008387d24e reply state 000000006b0b29f2 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10f64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432929.243869:0:15772:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787432929.243881:0:15772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1787432929.243988:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+9:14468:x1874258791878528:12345-192.168.202.15@tcp:36:lfs.0 Request processed in 711us (1398us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787432929.243995:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 24 00010000:00010000:0.0:1787432929.250220:0:3317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10f64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432929.250245:0:3317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10f64 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432929.250266:0:3317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10f64 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432929.250274:0:3317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432929.250281:0:3317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10f64 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432929.250311:0:3317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10f64 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432929.250345:0:3317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff935b9826d700) 00010000:00010000:0.0:1787432929.250350:0:3317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787432929.250357:0:3317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10f64 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432929.250365:0:3317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10f64 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432929.257275:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432929.257393:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791878784 00000100:00100000:1.0:1787432929.257412:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791878784 00000100:00100000:1.0:1787432929.257496:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:1.0:1787432929.257510:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+8:14468:x1874258791878784:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787432929.258076:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+9:14468:x1874258791878784:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 567us (816us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787432929.258085:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:3.0:1787432929.275000:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432929.275132:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791879040 00000100:00100000:2.0:1787432929.275147:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791879040 00000100:00100000:2.0:1787432929.275231:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:2.0:1787432929.275255:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+9:14468:x1874258791879040:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787432929.275290:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432929.275314:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10f6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a0260ad expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.275446:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.275465:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.275478:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.275496:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10f79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.275505:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10f79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.275512:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10f79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432929.275762:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787432929.275895:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.275905:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f72 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.275912:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.275919:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432929.275925:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.275933:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.275950:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9826d400) 00010000:00010000:2.0:1787432929.275954:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432929.275960:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.275967:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10f72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.275986:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10f79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.275992:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10f79 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.276008:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10f79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.276013:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432929.276017:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10f79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.276022:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10f79 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.276031:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff935b952e8d00) 00010000:00010000:2.0:1787432929.276033:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432929.276037:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10f79 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.276043:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10f79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.276094:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10f6b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260ad expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.276106:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9826d400) 00010000:00010000:2.0:1787432929.276109:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787432929.276113:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10f6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260ad expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.276124:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e000, rc 0) 00000100:00100000:2.0:1787432929.276225:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+10:14468:x1874258791879040:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 983us (1240us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787432929.276244:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:1.0:1787432929.279948:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432929.280106:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791879168 00000100:00100000:2.0:1787432929.280121:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791879168 00000100:00100000:2.0:1787432929.280202:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:2.0:1787432929.280215:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+10:14468:x1874258791879168:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787432929.280265:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432929.280300:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10f87 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a0260b4 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.280431:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f10f8e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.280448:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f10f8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.280463:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f10f8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432929.280530:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787432929.280534:0:14355:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787432929.280561:0:14355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f10f8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.280595:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10f87 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260b4 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.280619:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f10f8e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260b4 expref: 11 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.280691:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff935b952e8c00) 00010000:00010000:2.0:1787432929.280695:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787432929.280700:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5ec00, rc 0) 00000100:00100000:2.0:1787432929.280775:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+11:14468:x1874258791879168:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 563us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432929.280784:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:0.0:1787432929.285816:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432929.286056:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791879296 00000100:00100000:2.0:1787432929.286071:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791879296 00000100:00100000:2.0:1787432929.286141:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:2.0:1787432929.286153:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+11:14468:x1874258791879296:12345-192.168.202.15@tcp:37:lfs.0 00000100:00100000:2.0:1787432929.302254:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+11:14468:x1874258791879296:12345-192.168.202.15@tcp:37:lfs.0 Request processed in 16084us (16437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432929.302273:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:3.0:1787432929.313639:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432929.313775:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791879552 00000100:00100000:1.0:1787432929.313789:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791879552 00000100:00100000:1.0:1787432929.313874:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:1.0:1787432929.313887:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b4e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+11:14468:x1874258791879552:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787432929.314228:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b4e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+12:14468:x1874258791879552:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 343us (604us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787432929.314236:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00010000:00010000:0.0:1787432929.403489:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432929.429189:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432929.429392:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791879680 00000100:00100000:2.0:1787432929.429404:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791879680 00000100:00100000:2.0:1787432929.429557:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:2.0:1787432929.429572:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+10:14474:x1874258791879680:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787432929.429600:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432929.429628:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10f95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a0260bb expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.429754:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10f9c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.429771:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10f9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.429801:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10f9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.429820:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fa3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.429828:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.429835:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.429961:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10faa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.429971:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10faa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.429978:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10faa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432929.430018:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787432929.430022:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787432929.430065:0:14357:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10faa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.430078:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10f9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.430085:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10f9c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.430100:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10f9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.430108:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432929.430113:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10f9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.430121:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10f9c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.430135:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9826d400) 00010000:00010000:2.0:1787432929.430139:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432929.430145:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10f9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.430151:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f10f9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.430165:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.430171:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fa3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.430176:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.430180:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432929.430183:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.430199:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fa3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.430207:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff935b952e8d00) 00010000:00010000:2.0:1787432929.430209:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432929.430212:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fa3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.430218:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fa3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.430252:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10f95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260bb expref: 12 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.430280:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f000/0xbcb9e331c3f10faa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260bb expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.430288:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff935b952e8c00) 00010000:00010000:2.0:1787432929.430290:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787432929.430292:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f000, rc 0) 00000100:00100000:2.0:1787432929.430363:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+11:14474:x1874258791879680:12345-192.168.202.15@tcp:101:bash.0 Request processed in 795us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432929.430371:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:0.0:1787432929.440544:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432929.440624:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791879936 00000100:00100000:2.0:1787432929.440635:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791879936 00000100:00100000:2.0:1787432929.440730:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:2.0:1787432929.440741:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+11:14474:x1874258791879936:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787432929.440794:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432929.440822:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10fb1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a0260c2 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.440958:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fb8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.440974:0:14355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f10f8e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260b4 expref: 11 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.440984:0:14355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fb8 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.441022:0:14355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f10f8e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a0260b4 expref: 11 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.441038:0:14355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f10f8e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a0260b4 expref: 11 pid: 14355 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432929.441055:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb95ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14355:1874258812843776:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787432929.441172:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91a23a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787432929.446402:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb95ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14355:1874258812843776:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787432929.446450:0:14355:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fb8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432929.451309:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432929.452153:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791880064 00000100:00100000:2.0:1787432929.452171:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791880064 00010000:00010000:2.0:1787432929.452238:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f10f8e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a0260b4 expref: 12 pid: 14355 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432929.452354:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:2.0:1787432929.452367:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+12:2375:x1874258791880064:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432929.452387:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432929.452396:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f10f8e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a0260b4 expref: 12 pid: 14355 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.452413:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f10f8e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a0260b4 expref: 12 pid: 14355 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.452445:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f10f8e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a0260b4 expref: 12 pid: 14355 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.452472:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff935b952e8c00) 00010000:00010000:2.0:1787432929.452479:0:14340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fb8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.452492:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.452501:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fb8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.453009:0:14355:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.453033:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.453067:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030800/0xbcb9e331c3f10fbf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.453080:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030800/0xbcb9e331c3f10fbf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.453090:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030800/0xbcb9e331c3f10fbf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.454248:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10fc6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.454269:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.454281:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432929.454294:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787432929.454344:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.454353:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fb8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.454360:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fb8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.454367:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432929.454386:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fb8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.454395:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fb8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.454411:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff935b952e8c00) 00010000:00010000:3.0:1787432929.454415:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432929.454420:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fb8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.454426:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f10fb8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432929.454442:0:14355:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba2eabb2 reply state 00000000f42d070c transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030800/0xbcb9e331c3f10fbf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432929.454452:0:14355:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787432929.454502:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f10fb1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260c2 expref: 14 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.454518:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260c2 expref: 13 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.454526:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:3.0:1787432929.454529:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787432929.454531:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80031200, rc 0) 00000100:00100000:3.0:1787432929.454637:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+14:14474:x1874258791879936:12345-192.168.202.15@tcp:101:bash.0 Request processed in 13896us (14105us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787432929.454649:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 28 00010000:00010000:2.0:1787432929.455307:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432929.455365:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+11:2375:x1874258791880064:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 2997us (4072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432929.455377:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00010000:00010000:2.0:1787432929.471814:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030800/0xbcb9e331c3f10fbf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.471863:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030800/0xbcb9e331c3f10fbf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.471873:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030800/0xbcb9e331c3f10fbf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.471881:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432929.471888:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030800/0xbcb9e331c3f10fbf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.471897:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030800/0xbcb9e331c3f10fbf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.471922:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff935b9826d900) 00010000:00010000:2.0:1787432929.471925:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432929.471932:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030800/0xbcb9e331c3f10fbf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.471940:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030800/0xbcb9e331c3f10fbf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432929.484963:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432929.485072:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791880192 00000100:00100000:1.0:1787432929.485084:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791880192 00000100:00100000:1.0:1787432929.485160:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:1.0:1787432929.485172:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+13:14474:x1874258791880192:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787432929.485207:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432929.485235:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f10fd4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a0260c9 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432929.485355:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f10fdb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432929.485374:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f10fdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432929.485389:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f10fdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432929.485470:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787432929.485475:0:14356:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787432929.485500:0:14356:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f10fdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432929.486894:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f10fdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432929.486953:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f10fd4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260c9 expref: 15 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432929.486981:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f10fdb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260c9 expref: 14 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432929.486990:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:1.0:1787432929.486993:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432929.486998:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e6c00, rc 0) 00000100:00100000:1.0:1787432929.487098:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+14:14474:x1874258791880192:12345-192.168.202.15@tcp:101:bash.0 Request processed in 1926us (2147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432929.487109:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:1.0:1787432929.493254:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432929.501470:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791880448 00000100:00100000:2.0:1787432929.501486:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791880448 00000100:00100000:2.0:1787432929.504187:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:2.0:1787432929.504224:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+14:14474:x1874258791880448:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:2.0:1787432929.504690:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+15:14474:x1874258791880448:12345-192.168.202.15@tcp:35:bash.0 Request processed in 486us (11448us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787432929.504698:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:0.0:1787432929.641110:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432929.642448:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791880704 00000100:00100000:3.0:1787432929.642469:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791880704 00000100:00100000:3.0:1787432929.642592:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:3.0:1787432929.642606:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+15:14484:x1874258791880704:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432929.642645:0:15772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432929.642718:0:15772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f10fe2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a0260d0 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432929.642927:0:15772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787432929.643136:0:15772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f10fe2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260d0 expref: 17 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.643160:0:15772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9826d400) 00010000:00010000:3.0:1787432929.643163:0:15772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432929.643168:0:15772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f10fe2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260d0 expref: 17 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.643187:0:15772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80031000, rc 0) 00000100:00100000:3.0:1787432929.643286:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+16:14484:x1874258791880704:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 683us (2188us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1787432929.643292:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:0.0:1787432929.647028:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432929.647246:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791880960 00000100:00100000:1.0:1787432929.647260:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791880960 00000100:00100000:1.0:1787432929.647344:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:1.0:1787432929.647355:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+16:14484:x1874258791880960:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787432929.647930:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+17:14484:x1874258791880960:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 575us (912us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787432929.647957:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:1.0:1787432929.734549:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432929.736032:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791881216 00000100:00100000:0.0:1787432929.736044:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791881216 00000100:00100000:0.0:1787432929.736120:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:0.0:1787432929.736131:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+17:14487:x1874258791881216:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787432929.736158:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432929.736181:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f10ff0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a0260d7 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432929.736518:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10ff7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432929.736534:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432929.736547:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432929.736562:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787432929.736804:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f10ff0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260d7 expref: 20 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432929.736826:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260d7 expref: 19 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432929.736835:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:0.0:1787432929.736838:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787432929.736842:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1cf200, rc 0) 00000100:00100000:0.0:1787432929.736918:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+19:14487:x1874258791881216:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 789us (2378us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787432929.736926:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:0.0:1787432929.744269:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432929.744398:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791881344 00000100:00100000:2.0:1787432929.744409:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791881344 00000100:00100000:2.0:1787432929.744483:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:2.0:1787432929.744493:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+19:2378:x1874258791881344:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432929.744509:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432929.744536:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f10ff7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260d7 expref: 19 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432929.744558:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:2.0:1787432929.744564:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432929.752203:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+18:2378:x1874258791881344:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 7697us (7931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432929.752220:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:1.0:1787432929.756906:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432929.757044:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791881472 00000100:00100000:3.0:1787432929.757064:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791881472 00000100:00100000:3.0:1787432929.757171:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00100000:3.0:1787432929.757187:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+18:14487:x1874258791881472:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:3.0:1787432929.757498:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f11005 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.757642:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f11005 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.757710:0:15772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f11005 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.757757:0:15772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f11005 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.757766:0:15772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f11005 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.757775:0:15772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f11005 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.757782:0:15772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031e00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432929.757789:0:15772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f11005 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.757799:0:15772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f11005 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.757814:0:15772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:3.0:1787432929.757818:0:15772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432929.757823:0:15772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f11005 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432929.757830:0:15772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f11005 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432929.758058:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+18:14487:x1874258791881472:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 872us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432929.758074:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00100000:0.0:1787432929.763974:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432929.764103:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791881728 00000100:00100000:1.0:1787432929.764123:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791881728 00000100:00100000:1.0:1787432929.764224:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:1.0:1787432929.764237:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+18:14487:x1874258791881728:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787432929.764901:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+19:14487:x1874258791881728:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 663us (942us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787432929.764912:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:0.0:1787432930.116035:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432930.116191:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791881984 00000100:00100000:2.0:1787432930.116201:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791881984 00000100:00100000:2.0:1787432930.116296:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:2.0:1787432930.116308:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+19:14518:x1874258791881984:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:2.0:1787432930.116343:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432930.116367:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f1100c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a0260de expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.116477:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f11013 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.116493:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f11013 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.116505:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f11013 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432930.116531:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787432930.116713:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f1100c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260de expref: 22 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.116732:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f11013 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260de expref: 21 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.116740:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:2.0:1787432930.116743:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432930.116747:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e000, rc 0) 00000100:00100000:2.0:1787432930.116799:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+21:14518:x1874258791881984:12345-192.168.202.15@tcp:101:cat.0 Request processed in 495us (775us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787432930.116807:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00080000:0.0:1787432930.117499:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432930.120581:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432930.120641:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432930.120749:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791882240 00000100:00100000:1.0:1787432930.120760:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791882240 00000100:00100000:1.0:1787432930.120826:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:1.0:1787432930.120837:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+21:14518:x1874258791882240:12345-192.168.202.15@tcp:35:cat.0 00000100:00100000:1.0:1787432930.123638:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+22:14518:x1874258791882240:12345-192.168.202.15@tcp:35:cat.0 Request processed in 2790us (3066us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787432930.123655:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:0.0:1787432930.125562:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791882368 00000100:00100000:0.0:1787432930.125577:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791882368 00000100:00100000:3.0:1787432930.126190:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:3.0:1787432930.126205:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+22:2378:x1874258791882368:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432930.126223:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432930.126247:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f11013 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260de expref: 22 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432930.126267:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:3.0:1787432930.126272:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432930.126352:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+21:2378:x1874258791882368:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 151us (5709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432930.126359:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:3.0:1787432930.279274:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432930.280054:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791882624 00000100:00100000:2.0:1787432930.280063:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791882624 00000100:00100000:2.0:1787432930.280115:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:2.0:1787432930.280125:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+21:14524:x1874258791882624:12345-192.168.202.15@tcp:101:dd.0 00010000:00010000:2.0:1787432930.280150:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432930.280171:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f11021 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a0260e5 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.280263:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f11028 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.280274:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f11028 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.280298:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f11028 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432930.280329:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787432930.280472:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f11021 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260e5 expref: 24 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.280488:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f11028 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260e5 expref: 23 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.280494:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:2.0:1787432930.280496:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432930.280499:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e400, rc 0) 00000100:00100000:2.0:1787432930.280562:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+23:14524:x1874258791882624:12345-192.168.202.15@tcp:101:dd.0 Request processed in 440us (1296us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787432930.280567:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:1.0:1787432930.285699:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432930.285773:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791882880 00000100:00100000:2.0:1787432930.285787:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791882880 00000100:00100000:2.0:1787432930.285849:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:2.0:1787432930.285858:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+23:14524:x1874258791882880:12345-192.168.202.15@tcp:36:dd.0 00010000:00010000:2.0:1787432930.285933:0:14357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787432930.285959:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f11028 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260e5 expref: 23 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.285980:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f10fdb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260c9 expref: 22 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.286003:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:2.0:1787432930.286007:0:14357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787432930.286221:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f11036 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.286235:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f11036 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.286244:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f11036 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787432930.286298:0:14357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787432930.286350:0:14357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068d3a9a6 reply state 00000000379cf19b transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f11036 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432930.286360:0:14357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787432930.286471:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+24:14524:x1874258791882880:12345-192.168.202.15@tcp:36:dd.0 Request processed in 613us (818us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787432930.286477:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 35 00000020:00080000:2.0:1787432930.286481:0:14357:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787432930.295141:0:3317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f11036 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432930.295162:0:3317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f11036 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432930.295171:0:3317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f11036 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432930.295204:0:3317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432930.295211:0:3317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f11036 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432930.295220:0:3317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f11036 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432930.295245:0:3317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:1.0:1787432930.295261:0:3317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432930.295267:0:3317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f11036 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432930.295273:0:3317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e000/0xbcb9e331c3f11036 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432930.416499:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432930.417765:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791883136 00000100:00100000:2.0:1787432930.417784:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791883136 00000100:00100000:2.0:1787432930.417884:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:2.0:1787432930.417960:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+23:14524:x1874258791883136:12345-192.168.202.15@tcp:35:dd.0 00000100:00100000:2.0:1787432930.418870:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+24:14524:x1874258791883136:12345-192.168.202.15@tcp:35:dd.0 Request processed in 968us (2374us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1787432930.418883:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00010000:00010000:0.0:1787432930.422278:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432930.785464:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432930.785590:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791883264 00000100:00100000:2.0:1787432930.785627:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791883264 00000100:00100000:2.0:1787432930.785773:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:2.0:1787432930.785787:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+24:14538:x1874258791883264:12345-192.168.202.15@tcp:101:stat.0 00010000:00010000:2.0:1787432930.785822:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432930.785846:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f1103d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a0260ec expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.785929:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f11044 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.785942:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f11044 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.785953:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f11044 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.785966:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f1104b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.785973:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f1104b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.785978:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f1104b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788382:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f11052 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788406:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f11052 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788421:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f11052 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432930.788504:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787432930.788509:0:14355:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787432930.788557:0:14355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f11052 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788570:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f11052 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788580:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f11044 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788587:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f11044 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788595:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f11044 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788601:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5ec00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432930.788608:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f11044 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788616:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f11044 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788630:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff935b952e8c00) 00010000:00010000:2.0:1787432930.788634:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432930.788640:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f11044 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788646:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f11044 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788692:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f1104b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788698:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f1104b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788703:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f1104b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788708:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5fc00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432930.788711:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f1104b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788717:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f1104b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788725:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff935b952e8300) 00010000:00010000:2.0:1787432930.788727:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432930.788730:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f1104b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788736:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5fc00/0xbcb9e331c3f1104b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788783:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f1103d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260ec expref: 26 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788798:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f11052 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260ec expref: 25 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.788817:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:2.0:1787432930.788820:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432930.788822:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f800, rc 0) 00000100:00100000:2.0:1787432930.788931:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+25:14538:x1874258791883264:12345-192.168.202.15@tcp:101:stat.0 Request processed in 3145us (3481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432930.788941:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:3.0:1787432930.897348:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432930.916902:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791883520 00000100:00100000:1.0:1787432930.916922:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791883520 00000100:00100000:1.0:1787432930.917016:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:1.0:1787432930.917027:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+25:14544:x1874258791883520:12345-192.168.202.15@tcp:36:truncate.0 00010000:00010000:1.0:1787432930.917087:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432930.917117:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f11052 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260ec expref: 25 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432930.917141:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:1.0:1787432930.917146:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432930.918071:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f11059 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432930.918110:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f11059 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432930.918121:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f11059 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787432930.918211:0:14356:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:1.0:1787432930.918243:0:14356:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000986a4cba reply state 00000000de8e9d8a transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f11059 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432930.918253:0:14356:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787432930.919404:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+27:14544:x1874258791883520:12345-192.168.202.15@tcp:36:truncate.0 Request processed in 1382us (21079us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787432930.919423:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 37 00000020:00080000:1.0:1787432930.919443:0:14356:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787432930.927857:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f11059 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.927883:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f11059 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.927893:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f11059 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.927900:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e7600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432930.927907:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f11059 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.927916:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f11059 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.927941:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:2.0:1787432930.927944:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432930.927950:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f11059 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432930.927958:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7600/0xbcb9e331c3f11059 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432931.184628:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432931.190636:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791883648 00000100:00100000:0.0:1787432931.190653:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791883648 00000100:00100000:1.0:1787432931.191218:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:1.0:1787432931.194181:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+26:14558:x1874258791883648:12345-192.168.202.15@tcp:101:stat.0 00010000:00010000:1.0:1787432931.194215:0:15772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432931.197533:0:15772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f11060 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a0260f3 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.197726:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f11067 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.197743:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f11067 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.197757:0:15772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f11067 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.197790:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1106e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.197797:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1106e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.197804:0:15772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1106e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.198648:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f11075 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.198690:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f11075 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.198700:0:15772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f11075 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787432931.198750:0:15772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1787432931.198756:0:15772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787432931.198788:0:15772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f11075 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.198801:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f11075 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.198810:0:15772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f11067 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.198817:0:15772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f11067 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.199056:0:15772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f11067 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.199063:0:15772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6a00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432931.199067:0:15772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f11067 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.199076:0:15772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f11067 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.199092:0:15772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff935b952e8c00) 00010000:00010000:1.0:1787432931.199095:0:15772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432931.199100:0:15772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f11067 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.199107:0:15772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f11067 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.199125:0:15772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1106e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.199131:0:15772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1106e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.199136:0:15772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1106e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.199141:0:15772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432931.199145:0:15772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1106e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.199161:0:15772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1106e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.199170:0:15772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff935ba2a69500) 00010000:00010000:1.0:1787432931.199172:0:15772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432931.199175:0:15772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1106e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.199180:0:15772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1106e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.199229:0:15772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6c00/0xbcb9e331c3f11060 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260f3 expref: 28 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.199532:0:15772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f11075 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260f3 expref: 27 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.199539:0:15772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:1.0:1787432931.199542:0:15772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787432931.199544:0:15772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e7000, rc 0) 00000100:00100000:1.0:1787432931.199804:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+27:14558:x1874258791883648:12345-192.168.202.15@tcp:101:stat.0 Request processed in 5845us (15192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432931.199814:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:0.0:1787432931.291837:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432931.291891:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432931.291918:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432931.291958:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432931.291979:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432931.292014:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432931.292044:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791883904 00000100:00100000:0.0:1787432931.292054:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791883904 00000100:00100000:0.0:1787432931.292123:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791884416 00000100:00100000:0.0:1787432931.292127:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791884416 00000100:00100000:0.0:1787432931.292142:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791884032 00000100:00100000:0.0:1787432931.292144:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791884032 00000100:00100000:0.0:1787432931.292155:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791884288 00000100:00100000:0.0:1787432931.292157:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791884288 00000100:00100000:0.0:1787432931.292174:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:0.0:1787432931.292185:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+5:2375:x1874258791883904:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432931.292613:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+5:2375:x1874258791883904:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 428us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432931.292622:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:0.0:1787432931.292645:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:0.0:1787432931.292653:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+5:2375:x1874258791884416:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432931.292707:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+5:2375:x1874258791884416:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 56us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432931.292715:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:0.0:1787432931.292742:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:0.0:1787432931.292748:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+5:2375:x1874258791884032:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432931.292773:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+5:2375:x1874258791884032:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 25us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432931.292779:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:0.0:1787432931.292789:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:0.0:1787432931.292794:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba735180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+5:2375:x1874258791884288:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432931.292812:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba735180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+5:2375:x1874258791884288:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 18us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432931.292818:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00080000:0.0:1787432931.292835:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787432931.292839:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432931.293237:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791883776 00000100:00100000:1.0:1787432931.293244:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791883776 00000100:00100000:1.0:1787432931.293290:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 125 00000100:00100000:1.0:1787432931.293317:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba41b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+13:2375:x1874258791883776:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432931.293358:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba41b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d50bdb12-e88c-4003-a207-6f70712558c4+13:2375:x1874258791883776:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 61us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432931.293365:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 125 00000100:00100000:1.0:1787432931.293413:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791884160 00000100:00100000:1.0:1787432931.293417:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791884160 00000100:00100000:1.0:1787432931.293460:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:1.0:1787432931.293467:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbb5b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+11:2375:x1874258791884160:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787432931.293500:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbb5b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+11:2375:x1874258791884160:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 34us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432931.293507:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00080000:1.0:1787432931.293540:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787432931.383777:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432931.383993:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791884672 00000100:00100000:3.0:1787432931.384004:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791884672 00000100:00100000:3.0:1787432931.384073:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:3.0:1787432931.384085:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb95ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+27:14568:x1874258791884672:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787432931.384105:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432931.384126:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f1107c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a0260fa expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432931.384647:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787432931.384820:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f1107c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260fa expref: 29 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432931.384836:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9826d400) 00010000:00010000:3.0:1787432931.384839:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787432931.384917:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f1107c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260fa expref: 29 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432931.384935:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80031e00, rc 0) 00000100:00100000:3.0:1787432931.385060:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb95ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+28:14568:x1874258791884672:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 975us (1291us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1787432931.385068:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:3.0:1787432931.393775:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432931.394010:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791884928 00000100:00100000:0.0:1787432931.394022:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791884928 00000100:00100000:0.0:1787432931.394088:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:0.0:1787432931.394101:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a84b4cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+28:14568:x1874258791884928:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:0.0:1787432931.394401:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a84b4cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+29:14568:x1874258791884928:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 302us (636us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787432931.394410:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00010000:00010000:0.0:1787432931.445826:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432931.482560:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432931.482714:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791885184 00000100:00100000:1.0:1787432931.482724:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791885184 00000100:00100000:1.0:1787432931.482788:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00100000:1.0:1787432931.482798:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+29:14574:x1874258791885184:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787432931.482823:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787432931.482844:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1108a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a026101 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.482947:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f11091 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.482962:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10fc6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260c2 expref: 30 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.482970:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f11075 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a0260f3 expref: 30 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.482997:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f11091 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.483598:0:14356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f11075 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a0260f3 expref: 30 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.483614:0:14356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f11075 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a0260f3 expref: 30 pid: 15772 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432931.483627:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba888000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14356:1874258812843904:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787432931.483776:0:14356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a0260c2 expref: 30 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.483785:0:14356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10fc6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a0260c2 expref: 30 pid: 14355 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432931.483794:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba88b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14356:1874258812844032:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787432931.483818:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87c5de40 going to sleep for 11 seconds 00000100:00100000:1.0:1787432931.489186:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432931.489529:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791885312 00000100:00100000:0.0:1787432931.489539:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791885312 00010000:00010000:0.0:1787432931.489586:0:14342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f11075 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a0260f3 expref: 31 pid: 15772 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432931.489688:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:0.0:1787432931.489701:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+31:2375:x1874258791885312:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787432931.489717:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432931.489725:0:14342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f11075 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a0260f3 expref: 31 pid: 15772 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.489739:0:14342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f11075 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a0260f3 expref: 31 pid: 15772 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.489764:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:0.0:1787432931.489770:0:14342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f11091 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.489780:0:14342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f11091 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.489789:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787432931.489845:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+31:2375:x1874258791885312:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 147us (669us total) trans 0 rc 0/0 00010000:00010000:3.0:1787432931.489858:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7000/0xbcb9e331c3f11075 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a0260f3 expref: 31 pid: 15772 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432931.489860:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:3.0:1787432931.489893:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba888000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14356:1874258812843904:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787432931.490090:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba88b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14356:1874258812844032:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787432931.490129:0:14356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f11091 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432931.490207:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432931.490293:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791885440 00000100:00100000:1.0:1787432931.490298:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791885440 00010000:00010000:1.0:1787432931.490330:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10fc6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a0260c2 expref: 30 pid: 14355 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432931.490370:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:1.0:1787432931.490378:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba735880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+30:2376:x1874258791885440:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432931.490396:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432931.490401:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10fc6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a0260c2 expref: 30 pid: 14355 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.490412:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a0260c2 expref: 30 pid: 14355 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.490426:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031200/0xbcb9e331c3f10fc6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a0260c2 expref: 30 pid: 14355 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.490445:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:1.0:1787432931.490449:0:14340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f11091 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.490457:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f11091 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.490464:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f11091 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432931.490484:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432931.490530:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba735880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+29:2376:x1874258791885440:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 152us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432931.490537:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00010000:00010000:3.0:1787432931.491375:0:14356:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f11091 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432931.491386:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f11091 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432931.491406:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1787432931.491811:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6a00/0xbcb9e331c3f1108a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026101 expref: 30 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432931.491833:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f11091 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026101 expref: 29 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432931.491843:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:3.0:1787432931.491846:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787432931.491849:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba8e7800, rc 0) 00000100:00100000:3.0:1787432931.491897:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+29:14574:x1874258791885184:12345-192.168.202.15@tcp:101:bash.0 Request processed in 9100us (9346us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1787432931.491905:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00100000:1.0:1787432931.497177:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432931.497534:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791885696 00000100:00100000:0.0:1787432931.497547:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791885696 00000100:00100000:0.0:1787432931.497612:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:0.0:1787432931.497625:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+29:14574:x1874258791885696:12345-192.168.202.15@tcp:36:bash.0 00010000:00010000:0.0:1787432931.501768:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1109f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.501807:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1109f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.501820:0:15772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1109f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787432931.501944:0:15772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:0.0:1787432931.502005:0:15772:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3a6fc30 reply state 000000005d1ad7ae transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1109f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432931.502173:0:15772:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787432931.502320:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+32:14574:x1874258791885696:12345-192.168.202.15@tcp:36:bash.0 Request processed in 4684us (5140us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1787432931.502329:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 41 00000020:00080000:0.0:1787432931.502335:0:15772:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787432931.505212:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:0.0:1787432931.506025:0:3317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1109f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.506040:0:3317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1109f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.506049:0:3317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1109f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.506055:0:3317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba1ce800 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432931.506061:0:3317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1109f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.506070:0:3317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1109f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.506110:0:3317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:0.0:1787432931.506113:0:3317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432931.506119:0:3317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1109f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.506125:0:3317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f1109f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432931.506362:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791885824 00000100:00100000:2.0:1787432931.506384:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791885824 00000100:00100000:2.0:1787432931.506445:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:2.0:1787432931.506458:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba88b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+31:14574:x1874258791885824:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787432931.506484:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432931.506502:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f110a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a026108 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432931.506554:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f110a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026108 expref: 32 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432931.506567:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f110a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026108 expref: 32 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432931.506585:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:2.0:1787432931.506588:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787432931.506591:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5ec00, rc 0) 00000100:00100000:2.0:1787432931.506760:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba88b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+32:14574:x1874258791885824:12345-192.168.202.15@tcp:101:bash.0 Request processed in 304us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432931.506767:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:1.0:1787432931.513600:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432931.513767:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791885952 00000100:00100000:3.0:1787432931.513780:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791885952 00000100:00100000:3.0:1787432931.513860:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:3.0:1787432931.513872:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+32:14574:x1874258791885952:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:3.0:1787432931.513901:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432931.513933:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f110ad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a02610f expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432931.514051:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f110b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432931.514067:0:14355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f11091 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026101 expref: 33 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432931.514077:0:14355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f110b4 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432931.514147:0:14355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f11091 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x93816182a026101 expref: 33 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432931.514163:0:14355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f11091 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a026101 expref: 33 pid: 14356 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432931.514181:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14355:1874258812844160:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787432931.514331:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba051df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432931.517819:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432931.517943:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14355:1874258812844160:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787432931.517983:0:14355:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f110b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432931.520452:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791886080 00000100:00100000:2.0:1787432931.520471:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791886080 00010000:00010000:2.0:1787432931.520526:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f11091 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a026101 expref: 34 pid: 14356 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432931.520641:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:2.0:1787432931.520709:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba889880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+34:2375:x1874258791886080:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787432931.520729:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787432931.520738:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f11091 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a026101 expref: 34 pid: 14356 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432931.520756:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f11091 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x93816182a026101 expref: 34 pid: 14356 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432931.520780:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e7800/0xbcb9e331c3f11091 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x93816182a026101 expref: 34 pid: 14356 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432931.520799:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:2.0:1787432931.520806:0:14340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f110b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432931.520816:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f110b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432931.520824:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f110b4 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432931.520856:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787432931.520931:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba889880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+33:2375:x1874258791886080:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 225us (3130us total) trans 0 rc 0/0 00010000:00010000:3.0:1787432931.520935:0:14355:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f110b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432931.520944:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00010000:00010000:3.0:1787432931.520960:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f110b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787432931.521375:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787432931.521382:0:14355:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787432931.521416:0:14355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f110b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432931.521472:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031e00/0xbcb9e331c3f110ad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02610f expref: 33 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432931.521502:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f110b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02610f expref: 32 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432931.521545:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:3.0:1787432931.521548:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787432931.521553:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80031000, rc 0) 00000100:00100000:3.0:1787432931.521638:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+32:14574:x1874258791885952:12345-192.168.202.15@tcp:101:bash.0 Request processed in 7766us (8058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432931.521649:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:1.0:1787432931.526843:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432931.527163:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791886336 00000100:00100000:3.0:1787432931.527180:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791886336 00000100:00100000:3.0:1787432931.527375:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:3.0:1787432931.527389:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba889c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+32:14574:x1874258791886336:12345-192.168.202.15@tcp:103:bash.0 00010000:00010000:3.0:1787432931.527412:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787432931.527457:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f110b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02610f expref: 32 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432931.527489:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f110a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026108 expref: 31 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432931.527502:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d600) 00010000:00010000:3.0:1787432931.527710:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432931.527802:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba889c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+30:14574:x1874258791886336:12345-192.168.202.15@tcp:103:bash.0 Request processed in 414us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432931.527811:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:1.0:1787432931.530245:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432931.530463:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791886464 00000100:00100000:3.0:1787432931.530475:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791886464 00000100:00100000:3.0:1787432931.530563:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:3.0:1787432931.530576:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+30:14574:x1874258791886464:12345-192.168.202.15@tcp:58:bash.0 00010000:00010000:3.0:1787432931.530798:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f110bb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432931.530820:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f110bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432931.530835:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f110bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787432931.532073:0:14356:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787432931.532456:0:14356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1787432931.532548:0:14356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1787432931.532701:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+30:14574:x1874258791886464:12345-192.168.202.15@tcp:58:bash.0 Request processed in 2121us (2475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432931.532714:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:1.0:1787432931.534776:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432931.536078:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791886592 00000100:00100000:0.0:1787432931.536097:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791886592 00000100:00100000:0.0:1787432931.536172:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:0.0:1787432931.536184:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+30:14574:x1874258791886592:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787432931.536205:0:15772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432931.536227:0:15772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f110c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a026116 expref: -99 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.536289:0:15772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f110bb lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.536302:0:15772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f110c2 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026116 expref: 31 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.536338:0:15772:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f110bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.536365:0:15772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f110c2 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026116 expref: 31 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.536378:0:15772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d000) 00010000:00010000:0.0:1787432931.536395:0:15772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787432931.536399:0:15772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f110c2 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026116 expref: 31 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432931.536406:0:15772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bba1ce800, rc 0) 00000100:00100000:0.0:1787432931.536473:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+31:14574:x1874258791886592:12345-192.168.202.15@tcp:101:bash.0 Request processed in 291us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432931.536479:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:1.0:1787432931.577030:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812844672:0@lo:400:kworker.0 00000100:00100000:1.0:1787432931.577155:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432931.577559:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d00b432-f54a-428d-8e42-8523236fbac8:3330:1874258812844288:0@lo:400:kworker.0 00000100:00100000:3.0:1787432931.577577:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812844416:0@lo:400:kworker.0 00000100:00100000:3.0:1787432931.577646:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432931.577963:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812844672 00000100:00100000:0.0:1787432931.577974:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812844672 00000100:00100000:0.0:1787432931.578043:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787432931.578073:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812844672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432931.578180:0:3333:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787432931.578208:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba0aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812844544:0@lo:400:kworker.0 00000100:00100000:3.0:1787432931.586896:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812844928:0@lo:400:kworker.0 00000100:00100000:2.0:1787432931.591259:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432931.591727:0:3330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812844800:0@lo:400:kworker.0 00000100:00100000:2.0:1787432931.591819:0:3330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432931.591967:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812844288 00000100:00100000:2.0:1787432931.591975:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812844288 00000100:00100000:2.0:1787432931.594633:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787432931.594679:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+19:3330:x1874258812844288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432931.594812:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d00b432-f54a-428d-8e42-8523236fbac8+19:3330:x1874258812844288:12345-0@lo:400:kworker.0 Request processed in 162us (4803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432931.594821:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787432931.594887:0:3332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbad28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812845056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787432931.594927:0:3332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432931.595757:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d00b432-f54a-428d-8e42-8523236fbac8:3330:1874258812844288:0@lo:400:kworker.0 00000100:00100000:0.0:1787432931.595806:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812844800 00000100:00100000:0.0:1787432931.595813:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812844800 00000100:00100000:0.0:1787432931.595874:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787432931.595883:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812844800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787432931.595942:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3330:x1874258812844800:12345-0@lo:400:kworker.0 Request processed in 60us (4123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432931.595950:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787432931.595978:0:3330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3330:1874258812844800:0@lo:400:kworker.0 00000100:00100000:0.0:1787432931.596007:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3333:x1874258812844672:12345-0@lo:400:kworker.0 Request processed in 17956us (18854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432931.596012:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787432931.597230:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787432931.597301:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432931.597398:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812844416 00000100:00100000:1.0:1787432931.597418:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812844416 00000100:00100000:1.0:1787432931.597495:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812844544 00000100:00100000:1.0:1787432931.597500:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812844544 00000100:00100000:1.0:1787432931.597527:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787432931.597541:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812844416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787432931.597606:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787432931.597629:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787432931.597635:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812844416:12345-0@lo:400:kworker.0 Request processed in 95us (19986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432931.597646:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787432931.597702:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787432931.597709:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812844544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432931.597746:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812844544:12345-0@lo:400:kworker.0 Request processed in 37us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432931.597752:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787432931.597771:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787432931.597778:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787432931.597828:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812844544:0@lo:400:kworker.0 00000100:00100000:1.0:1787432931.597853:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3333:1874258812844672:0@lo:400:kworker.0 00000100:00100000:3.0:1787432931.598825:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787432931.598910:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812845056 00000100:00100000:3.0:1787432931.598920:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812845056 00000100:00100000:3.0:1787432931.598982:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787432931.598991:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812845056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787432931.599049:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787432931.599117:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3332:x1874258812845056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (4190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432931.599124:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787432931.599187:0:3332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbad28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3332:1874258812845056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787432931.599272:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba0a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812844416:0@lo:400:kworker.0 00000100:00100000:1.0:1787432931.601574:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812844928 00000100:00100000:1.0:1787432931.601623:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812844928 00000100:00100000:1.0:1787432931.601754:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787432931.601769:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812844928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787432931.601914:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3331:x1874258812844928:12345-0@lo:400:kworker.0 Request processed in 149us (3094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432931.601924:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787432931.601976:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3331:1874258812844928:0@lo:400:kworker.0 00000100:00080000:0.0:1787432931.602067:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787432932.086492:0:3333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812845184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787432932.086628:0:3333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432932.086914:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812845184 00000100:00100000:1.0:1787432932.086926:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812845184 00000100:00100000:1.0:1787432932.087008:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787432932.087021:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812845184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787432932.087081:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787432932.087366:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3333:x1874258812845184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 345us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432932.087377:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787432932.109653:0:3333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3333:1874258812845184:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1787432932.280736:0:14389:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787432932.280748:0:14389:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787432932.280811:0:14389:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787432932.280818:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787432932.280976:0:14389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14389:1874258812845312:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787432932.281077:0:14389:0:(client.c:2715:ptlrpc_set_wait()) set ffff935ba051df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787432932.289225:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432932.289477:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791886720 00000100:00100000:2.0:1787432932.289494:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791886720 00000100:00100000:2.0:1787432932.289600:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:2.0:1787432932.289614:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1437e822-c48b-4d58-8b99-8f0f7949835b+32:14575:x1874258791886720:12345-192.168.202.15@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787432932.289744:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1437e822-c48b-4d58-8b99-8f0f7949835b+32:14575:x1874258791886720:12345-192.168.202.15@tcp:900:lhsmtool_posix.0 Request processed in 132us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432932.289752:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00080000:0.0:1787432932.290003:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432932.290371:0:14389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14389:1874258812845312:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787432932.301123:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432932.301228:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791886848 00000100:00100000:0.0:1787432932.301247:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791886848 00000100:00100000:0.0:1787432932.301379:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:0.0:1787432932.301392:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+31:14575:x1874258791886848:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787432932.301430:0:14355:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787432932.301599:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+31:14575:x1874258791886848:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 209us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432932.301608:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:1.0:1787432932.318542:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432932.318677:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791886976 00000100:00100000:2.0:1787432932.318689:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791886976 00000100:00100000:2.0:1787432932.318758:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:2.0:1787432932.318769:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+31:14575:x1874258791886976:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787432932.318850:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f110c9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.318880:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f110c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.318894:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f110c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.318950:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f110d0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.318958:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f110d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.318964:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f110d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.318986:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f110d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.318993:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f110d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.318999:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f110d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432932.319037:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787432932.319041:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787432932.319053:0:14357:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f110d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.319063:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f110c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.319078:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f110c9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.319085:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f110c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.320352:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432932.320359:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f110c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.320368:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f110c9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.320384:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff935b952e8700) 00010000:00010000:2.0:1787432932.320388:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432932.320392:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f110c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.320399:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f600/0xbcb9e331c3f110c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.320416:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f110d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.320423:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f110d0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.320430:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f110d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.320436:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5f400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432932.320449:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f110d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.320456:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f110d0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.320463:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff935b952e8300) 00010000:00010000:2.0:1787432932.320466:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432932.320469:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f110d0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.320475:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f400/0xbcb9e331c3f110d0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.320495:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f110d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.320501:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f110d7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.320506:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f110d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.320511:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5ec00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432932.320514:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f110d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.320520:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f110d7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.320528:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d000) 00010000:00010000:2.0:1787432932.320530:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787432932.320540:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f110d7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.320547:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f110d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432932.320835:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+31:14575:x1874258791886976:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 Request processed in 2063us (2301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787432932.320845:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:1.0:1787432932.333015:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432932.333104:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791887232 00000100:00100000:2.0:1787432932.333114:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791887232 00000100:00100000:2.0:1787432932.333173:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:2.0:1787432932.333185:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+31:14575:x1874258791887232:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787432932.333206:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432932.333227:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f110de lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a02611d expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.333339:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f110e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.333355:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f110e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.333367:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f110e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432932.333378:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787432932.333485:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f110e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.333492:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f110e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.333512:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f110e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.333518:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bbaa5e400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432932.333522:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f110e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.333529:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f110e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.333542:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d000) 00010000:00010000:2.0:1787432932.333545:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787432932.333550:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f110e5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.333556:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f110e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.333600:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f110de lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02611d expref: 33 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.333612:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff935b952e8700) 00010000:00010000:2.0:1787432932.333614:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787432932.333619:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f110de lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02611d expref: 33 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.333629:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5f800, rc 0) 00000100:00100000:2.0:1787432932.333722:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+32:14575:x1874258791887232:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 539us (715us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1787432932.333738:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:2.0:1787432932.336982:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432932.337078:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791887360 00000100:00100000:1.0:1787432932.337087:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791887360 00000100:00100000:1.0:1787432932.337158:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:1.0:1787432932.337172:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+32:14575:x1874258791887360:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787432932.337214:0:15772:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787432932.337352:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+32:14575:x1874258791887360:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 182us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432932.337361:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:1.0:1787432932.340958:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432932.341848:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791887616 00000100:00100000:2.0:1787432932.341859:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791887616 00000100:00100000:2.0:1787432932.341920:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:2.0:1787432932.341931:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+32:14575:x1874258791887616:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787432932.341954:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432932.341976:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f110f3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a026124 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787432932.342694:0:14356:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1787432932.342704:0:14356:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1787432932.342759:0:14356:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1787432932.343039:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f110fa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.343055:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f110fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.343068:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f110fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.343128:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5f800/0xbcb9e331c3f110f3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026124 expref: 35 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.343147:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f110fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026124 expref: 34 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.343168:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff935b952e8300) 00010000:00010000:2.0:1787432932.343171:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787432932.343175:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5e400, rc 0) 00000100:00100000:2.0:1787432932.343246:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+34:14575:x1874258791887616:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 1316us (2299us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787432932.343255:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:0.0:1787432932.348067:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432932.349738:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791887872 00000100:00100000:1.0:1787432932.349754:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791887872 00000100:00100000:1.0:1787432932.349872:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:1.0:1787432932.349884:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+34:14575:x1874258791887872:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787432932.349955:0:15772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432932.349985:0:15772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5e400/0xbcb9e331c3f110fa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026124 expref: 34 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.350006:0:15772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff935b952e8300) 00010000:00010000:1.0:1787432932.350017:0:15772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787432932.350046:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f11108 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.350062:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f11108 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.350073:0:15772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f11108 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.350377:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1110f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x677090a6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.350387:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1110f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x677090a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.350395:0:15772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1110f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x677090a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.350479:0:15772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f11108 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.350505:0:15772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f11108 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.350512:0:15772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f11108 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.350518:0:15772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432932.350522:0:15772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f11108 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.350530:0:15772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f11108 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.350540:0:15772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff935b952e8c00) 00010000:00010000:1.0:1787432932.350543:0:15772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432932.350547:0:15772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f11108 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.350553:0:15772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6000/0xbcb9e331c3f11108 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.350564:0:15772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1110f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x677090a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.350570:0:15772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1110f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x677090a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.350575:0:15772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1110f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x677090a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.350580:0:15772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bba8e6400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432932.350589:0:15772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1110f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x677090a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.350594:0:15772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1110f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x677090a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.350601:0:15772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x677090a6 (ffff935ba2a69500) 00010000:00010000:1.0:1787432932.350603:0:15772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432932.350606:0:15772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1110f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x677090a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.350610:0:15772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba8e6400/0xbcb9e331c3f1110f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x677090a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432932.350796:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+33:14575:x1874258791887872:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 912us (2741us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787432932.350803:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:1.0:1787432932.358617:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432932.358883:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791888000 00000100:00100000:2.0:1787432932.358893:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791888000 00000100:00100000:0.0:1787432932.359296:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:0.0:1787432932.359324:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+33:14575:x1874258791888000:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432932.359345:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432932.359372:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f11116 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a02612b expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.359408:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211a00/0xbcb9e331c3f1111d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.359422:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211a00/0xbcb9e331c3f1111d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.359435:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211a00/0xbcb9e331c3f1111d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.359552:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1cf200/0xbcb9e331c3f11116 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02612b expref: 35 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.359572:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211a00/0xbcb9e331c3f1111d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02612b expref: 34 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.359582:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff935b9838fa00) 00010000:00010000:0.0:1787432932.359585:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787432932.359588:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bb5211a00, rc 0) 00000100:00100000:0.0:1787432932.359776:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+34:14575:x1874258791888000:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 455us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432932.359783:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:2.0:1787432932.364313:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432932.364400:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791888256 00000100:00100000:0.0:1787432932.364417:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791888256 00000100:00100000:0.0:1787432932.364495:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:0.0:1787432932.364505:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbad28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+34:14575:x1874258791888256:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787432932.364605:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211600/0xbcb9e331c3f11124 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.364625:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211600/0xbcb9e331c3f11124 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.364638:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211600/0xbcb9e331c3f11124 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787432932.365941:0:14357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1787432932.365958:0:14357:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 567031300111ns, next at 568031296736ns, rc = 0 00000004:00010000:0.0:1787432932.366076:0:14357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a6427fc reply state 00000000d7fd95d4 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211600/0xbcb9e331c3f11124 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432932.366087:0:14357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787432932.366893:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbad28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+36:14575:x1874258791888256:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 2384us (2608us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1787432932.366903:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 53 00010000:00010000:2.0:1787432932.378239:0:3316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211600/0xbcb9e331c3f11124 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.378262:0:3316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211600/0xbcb9e331c3f11124 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.378270:0:3316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211600/0xbcb9e331c3f11124 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.378278:0:3316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bb5211600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432932.378283:0:3316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211600/0xbcb9e331c3f11124 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.378290:0:3316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211600/0xbcb9e331c3f11124 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.378319:0:3316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff935b9838fa00) 00010000:00010000:2.0:1787432932.378323:0:3316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787432932.378328:0:3316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211600/0xbcb9e331c3f11124 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.378361:0:3316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211600/0xbcb9e331c3f11124 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432932.392391:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432932.392978:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791888384 00000100:00100000:3.0:1787432932.392998:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791888384 00000100:00100000:3.0:1787432932.393169:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 54 00000100:00100000:3.0:1787432932.393183:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+35:14575:x1874258791888384:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432932.393218:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432932.393246:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f1112b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a026132 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.393415:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f1112b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026132 expref: 36 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.393434:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f1112b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026132 expref: 36 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.393459:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff935b9838fa00) 00010000:00010000:3.0:1787432932.393463:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787432932.393468:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80031000, rc 0) 00000100:00100000:3.0:1787432932.393919:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+36:14575:x1874258791888384:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 735us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432932.393947:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 54 00000100:00100000:1.0:1787432932.401134:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432932.401435:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791888512 00000100:00100000:3.0:1787432932.401452:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791888512 00000100:00100000:3.0:1787432932.401541:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:0.0:1787432932.402879:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+5:2377:x1874258791888512:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787432932.404545:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+6:2377:x1874258791888512:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 1972us (3413us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787432932.404561:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:2.0:1787432932.411626:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432932.411861:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791888768 00000100:00100000:0.0:1787432932.411876:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791888768 00000100:00100000:0.0:1787432932.411954:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:0.0:1787432932.411967:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+36:14575:x1874258791888768:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787432932.412318:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+37:14575:x1874258791888768:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 352us (722us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1787432932.412326:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:2.0:1787432932.415591:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432932.415845:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791889024 00000100:00100000:1.0:1787432932.415861:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791889024 00000100:00100000:1.0:1787432932.415955:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:1.0:1787432932.415970:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+37:14575:x1874258791889024:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787432932.416145:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+37:14575:x1874258791889024:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 177us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432932.416154:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:1.0:1787432932.420948:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432932.421160:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791889152 00000100:00100000:0.0:1787432932.421176:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791889152 00000100:00100000:0.0:1787432932.421407:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:0.0:1787432932.421422:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+37:14575:x1874258791889152:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432932.421452:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432932.421484:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210a00/0xbcb9e331c3f11132 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a026139 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.422146:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211c00/0xbcb9e331c3f11139 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.422169:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211c00/0xbcb9e331c3f11139 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.422184:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211c00/0xbcb9e331c3f11139 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787432932.422251:0:14356:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787432932.422279:0:14356:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211c00/0xbcb9e331c3f11139 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.422332:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210a00/0xbcb9e331c3f11132 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026139 expref: 39 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.422359:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211c00/0xbcb9e331c3f11139 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026139 expref: 38 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.422370:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff935b9838fa00) 00010000:00010000:0.0:1787432932.422373:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787432932.422379:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bb5211c00, rc 0) 00000100:00100000:0.0:1787432932.422477:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+38:14575:x1874258791889152:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 1059us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432932.422487:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:2.0:1787432932.432242:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432932.432422:0:16590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791889280 00000100:00100000:0.0:1787432932.432436:0:16590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791889280 00000100:00100000:0.0:1787432932.432521:0:16590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:0.0:1787432932.432554:0:16590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+6:2375:x1874258791889280:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787432932.432581:0:16590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432932.432611:0:16590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000468236d8/0xbcb9e331c3f11140 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a026140 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787432932.432646:0:16590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a0fe4, blocks: 0x1 00010000:00010000:0.0:1787432932.432748:0:16590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1787432932.432753:0:16590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432932.432765:0:16590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000468236d8/0xbcb9e331c3f11140 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026140 expref: 7 pid: 16590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.432791:0:16590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000468236d8/0xbcb9e331c3f11140 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026140 expref: 7 pid: 16590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.432808:0:16590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bb5210a00, rc 0) 00000100:00100000:0.0:1787432932.432885:0:16590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+7:2375:x1874258791889280:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 334us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432932.432893:0:16590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:1.0:1787432932.437831:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432932.437980:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791889536 00000100:00100000:0.0:1787432932.437996:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791889536 00000100:00100000:0.0:1787432932.438075:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:0.0:1787432932.438091:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+38:14575:x1874258791889536:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787432932.438282:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+38:14575:x1874258791889536:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 194us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432932.438292:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:0.0:1787432932.445476:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432932.445714:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791889664 00000100:00100000:3.0:1787432932.445729:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791889664 00000100:00100000:3.0:1787432932.445820:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 58 00000100:00100000:3.0:1787432932.445834:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+38:14575:x1874258791889664:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1787432932.477567:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787432932.499485:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:2.0:1787432932.499511:0:5889:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787432932.499552:0:5889:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1787432932.499841:0:3331:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787432932.499862:0:3331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bbaa61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812845440:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787432932.499941:0:3331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787432932.500012:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812845440 00000100:00100000:1.0:1787432932.500020:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812845440 00000100:00100000:1.0:1787432932.500070:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787432932.500079:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3331:x1874258812845440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787432932.500429:0:15041:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787432932.500433:0:15041:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787432932.500436:0:15041:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787432932.500438:0:15041:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787432932 -> 1787432932 00002000:00010000:1.0:1787432932.500441:0:15041:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787432932.500585:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3331:x1874258812845440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 505us (641us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787432932.500594:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787432932.500786:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+13:14575:x1874258791889664:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 Request processed in 54952us (55324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432932.500796:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 58 00000004:00080000:2.0:1787432932.501804:0:3331:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff935bbaa61c00/2, rc 0, transno 8589934595 00000100:00100000:2.0:1787432932.501813:0:3331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bbaa61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3331:1874258812845440:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787432932.504546:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432932.504828:0:16590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791889792 00000100:00100000:0.0:1787432932.504837:0:16590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791889792 00000100:00100000:0.0:1787432932.505101:0:16590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:0.0:1787432932.505114:0:16590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+7:2376:x1874258791889792:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787432932.505263:0:16590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+7:2376:x1874258791889792:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 Request processed in 151us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432932.505279:0:16590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:1.0:1787432932.516704:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432932.516858:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791890048 00000100:00100000:0.0:1787432932.516871:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791890048 00000100:00100000:0.0:1787432932.516992:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:0.0:1787432932.517002:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+13:14575:x1874258791890048:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787432932.517060:0:15772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787432932.517087:0:15772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211c00/0xbcb9e331c3f11139 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026139 expref: 13 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.517109:0:15772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff935b9838fa00) 00010000:00010000:0.0:1787432932.517113:0:15772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787432932.517143:0:15772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210400/0xbcb9e331c3f11147 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.517158:0:15772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210400/0xbcb9e331c3f11147 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.517169:0:15772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210400/0xbcb9e331c3f11147 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787432932.517554:0:15772:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025dcf5b6 reply state 0000000046b4fc61 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210400/0xbcb9e331c3f11147 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432932.517564:0:15772:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787432932.517765:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+14:14575:x1874258791890048:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 763us (1114us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1787432932.517773:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:2.0:1787432932.521778:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432932.522241:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791890176 00000100:00100000:3.0:1787432932.522251:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791890176 00000100:00100000:3.0:1787432932.522333:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:3.0:1787432932.522345:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+7:14575:x1874258791890176:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787432932.522363:0:15041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787432932.522384:0:15041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f1114e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a026147 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.522415:0:15041:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000468236d8/0xbcb9e331c3f11140 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026140 expref: 8 pid: 16590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.522424:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432932.522427:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432932.522431:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f1114e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026147 expref: 8 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.522468:0:15041:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000468236d8/0xbcb9e331c3f11140 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a026140 expref: 8 pid: 16590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.522499:0:15041:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000468236d8/0xbcb9e331c3f11140 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a026140 expref: 8 pid: 16590 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432932.522514:0:15041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15041:1874258812845568:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787432932.522603:0:15041:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b989d5b40 going to sleep for 11 seconds 00010000:00010000:1.0:1787432932.524673:0:3317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210400/0xbcb9e331c3f11147 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.524690:0:3317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210400/0xbcb9e331c3f11147 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.524697:0:3317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210400/0xbcb9e331c3f11147 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.524703:0:3317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bb5210400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:1.0:1787432932.524707:0:3317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210400/0xbcb9e331c3f11147 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.524715:0:3317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210400/0xbcb9e331c3f11147 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.524750:0:3317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff935b9838fa00) 00010000:00010000:1.0:1787432932.524753:0:3317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787432932.524759:0:3317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210400/0xbcb9e331c3f11147 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.524766:0:3317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210400/0xbcb9e331c3f11147 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432932.525129:0:15041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15041:1874258812845568:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787432932.525163:0:15041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f1114e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a026147 expref: 8 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.525184:0:15041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935b80031e00, rc 0) 00000100:00100000:3.0:1787432932.525243:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+8:14575:x1874258791890176:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 2901us (3475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432932.525253:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:2.0:1787432932.528464:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432932.528629:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791890304 00000100:00100000:3.0:1787432932.528641:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791890304 00010000:00010000:3.0:1787432932.528769:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000468236d8/0xbcb9e331c3f11140 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a026140 expref: 8 pid: 16590 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432932.528804:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:3.0:1787432932.528814:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935a8705df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+8:2376:x1874258791890304:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432932.528831:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432932.528854:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000468236d8/0xbcb9e331c3f11140 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a026140 expref: 8 pid: 16590 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.528887:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000468236d8/0xbcb9e331c3f11140 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a026140 expref: 8 pid: 16590 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.528912:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000468236d8/0xbcb9e331c3f11140 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a026140 expref: 8 pid: 16590 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.528931:0:14341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432932.528935:0:14341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432932.528942:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f1114e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x93816182a026147 expref: 7 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.528952:0:14341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f1114e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x93816182a026147 expref: 7 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.528989:0:14341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f1114e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a026147 expref: 7 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432932.529004:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14341:1874258812845696:192.168.202.15@tcp:105: 00000100:00100000:3.0:1787432932.529179:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b989d5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432932.534126:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14341:1874258812845696:192.168.202.15@tcp:105: 00010000:00010000:3.0:1787432932.534153:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432932.534263:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935a8705df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+7:2376:x1874258791890304:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 5449us (5810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432932.534321:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:0.0:1787432932.536032:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432932.537714:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791890432 00000100:00100000:1.0:1787432932.537736:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791890432 00000100:00100000:1.0:1787432932.537826:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:1.0:1787432932.537839:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba737800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+7:2375:x1874258791890432:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787432932.538094:0:15040:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787432932.538099:0:15040:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787432931 00002000:00010000:1.0:1787432932.538101:0:15040:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787432929 00002000:00010000:1.0:1787432932.538103:0:15040:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787432932 -> 1787432931 00002000:00010000:1.0:1787432932.538105:0:15040:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787432932.538180:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba737800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+8:2375:x1874258791890432:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 343us (2158us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787432932.538189:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:0.0:1787432932.541638:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432932.541742:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791890560 00000100:00100000:3.0:1787432932.541754:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791890560 00000100:00100000:3.0:1787432932.541811:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:3.0:1787432932.541822:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba737100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+8:2378:x1874258791890560:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787432932.541867:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f11155 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.541888:0:15042:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f1114e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x93816182a026147 expref: 8 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.541896:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787432932.541900:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787432932.541904:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f11155 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.541939:0:15042:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f1114e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x93816182a026147 expref: 8 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.541954:0:15042:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f1114e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a026147 expref: 8 pid: 15041 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432932.541969:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bb9fd3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15042:1874258812845824:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787432932.542044:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b989d5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787432932.545613:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432932.546491:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791890688 00000100:00100000:1.0:1787432932.546501:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791890688 00010000:00010000:1.0:1787432932.546561:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f1114e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a026147 expref: 9 pid: 15041 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787432932.546612:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:1.0:1787432932.546623:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+9:2375:x1874258791890688:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787432932.546649:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787432932.546702:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f1114e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a026147 expref: 9 pid: 15041 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.546716:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f1114e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x93816182a026147 expref: 9 pid: 15041 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.546743:0:14340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787432932.546748:0:14340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787432932.546754:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f11155 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.546765:0:14340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f11155 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.546790:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787432932.546857:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+9:2375:x1874258791890688:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 236us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432932.546866:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00010000:00010000:0.0:1787432932.548187:0:15042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1400419/0xbcb9e331c3f1114e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x93816182a026147 expref: 8 pid: 15041 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432932.548380:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bb9fd3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15042:1874258812845824:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787432932.548405:0:15042:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f11155 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.548418:0:15042:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f11155 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.548425:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f11155 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.548458:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f11155 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.548489:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f11155 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.548497:0:15042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f11155 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.548503:0:15042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030200 already unused, calling callback (ffffffffc1752230) 00010000:00010000:0.0:1787432932.548508:0:15042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f11155 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.548604:0:15042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f11155 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.548624:0:15042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f11155 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.548632:0:15042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000656005ad/0xbcb9e331c3f11155 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432932.548880:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba737100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+7:2378:x1874258791890560:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 Request processed in 7059us (7250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432932.548891:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:2.0:1787432932.552150:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432932.552244:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791890944 00000100:00100000:0.0:1787432932.552256:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791890944 00000100:00100000:0.0:1787432932.552345:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:0.0:1787432932.552368:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+13:14575:x1874258791890944:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787432932.552461:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210600/0xbcb9e331c3f1115c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.552480:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210600/0xbcb9e331c3f1115c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.552491:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210600/0xbcb9e331c3f1115c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.552803:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210a00/0xbcb9e331c3f11163 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.552815:0:14355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f1112b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026132 expref: 14 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.552823:0:14355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210a00/0xbcb9e331c3f11163 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.552859:0:14355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f1112b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x93816182a026132 expref: 14 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.552873:0:14355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f1112b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a026132 expref: 14 pid: 14355 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432932.552888:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba735f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14355:1874258812845952:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787432932.552965:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b87dc2780 going to sleep for 11 seconds 00000100:00100000:0.0:1787432932.557736:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba735f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14355:1874258812845952:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787432932.557772:0:14355:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210a00/0xbcb9e331c3f11163 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432932.559152:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432932.559393:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791891072 00000100:00100000:3.0:1787432932.559404:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791891072 00010000:00010000:3.0:1787432932.559454:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f1112b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a026132 expref: 15 pid: 14355 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432932.559500:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:3.0:1787432932.559511:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba864380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+15:2376:x1874258791891072:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787432932.559526:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787432932.559533:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f1112b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a026132 expref: 15 pid: 14355 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.559547:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f1112b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x93816182a026132 expref: 15 pid: 14355 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.559572:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f1112b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x93816182a026132 expref: 15 pid: 14355 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.559594:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff935b9838fa00) 00010000:00010000:3.0:1787432932.559601:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210a00/0xbcb9e331c3f11163 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.559610:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210a00/0xbcb9e331c3f11163 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.559618:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210a00/0xbcb9e331c3f11163 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.559756:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787432932.559816:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba864380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+14:2376:x1874258791891072:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 306us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432932.559839:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00010000:00010000:0.0:1787432932.563009:0:14355:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210a00/0xbcb9e331c3f11163 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.563028:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210a00/0xbcb9e331c3f11163 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787432932.563409:0:14355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1787432932.563585:0:14355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1787432932.563740:0:14355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1787432932.563849:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba735f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14355:1874258812846080:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787432932.563961:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787432932.564061:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b82ce20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787432932.564130:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812846080 00000100:00100000:1.0:1787432932.564138:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812846080 00000100:00100000:1.0:1787432932.564229:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787432932.564240:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14355:x1874258812846080:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787432932.564470:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14355:x1874258812846080:12345-0@lo:1000:mdt00_000.0 Request processed in 231us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787432932.564477:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787432932.564579:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba735f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14355:1874258812846080:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787432932.565334:0:14355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1787432932.565407:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba867100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14355:1874258812846208:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787432932.565450:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787432932.566441:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91a233c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787432932.566542:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258812846208 00000100:00100000:0.0:1787432932.566550:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258812846208 00000100:00100000:0.0:1787432932.566593:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787432932.566602:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14355:x1874258812846208:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787432932.566842:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14355:x1874258812846208:12345-0@lo:1000:mdt00_000.0 Request processed in 241us (1391us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787432932.566851:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787432932.566962:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba867100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14355:1874258812846208:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787432932.567002:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210a00/0xbcb9e331c3f11163 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.567012:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210a00/0xbcb9e331c3f11163 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.567026:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210a00/0xbcb9e331c3f11163 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.567032:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bb5210a00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432932.567036:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210a00/0xbcb9e331c3f11163 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.567043:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210a00/0xbcb9e331c3f11163 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.567058:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff935b9838fa00) 00010000:00010000:2.0:1787432932.567061:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787432932.567065:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210a00/0xbcb9e331c3f11163 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.567071:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210a00/0xbcb9e331c3f11163 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.567106:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f110bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.567113:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f110bb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.567118:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f110bb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.567122:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031c00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:2.0:1787432932.567125:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f110bb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.567140:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f110bb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.567148:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d000) 00010000:00010000:2.0:1787432932.567151:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787432932.567158:0:14355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f110c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026116 expref: 17 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.567170:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f110c2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026116 expref: 17 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.567178:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f110c2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026116 expref: 17 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.567207:0:14355:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff935bba1ce800/0xbcb9e331c3f110c2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026116 expref: 17 pid: 15772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787432932.567411:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff935bba867480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14355:1874258812846336:192.168.202.15@tcp:105: 00000100:00100000:2.0:1787432932.567495:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff935b91a233c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787432932.570991:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432932.571117:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff935bba867480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14355:1874258812846336:192.168.202.15@tcp:105: 00010000:00010000:0.0:1787432932.571154:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f110bb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.571164:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031c00/0xbcb9e331c3f110bb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.571204:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211c00/0xbcb9e331c3f1116a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.571250:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211c00/0xbcb9e331c3f1116a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.571262:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211c00/0xbcb9e331c3f1116a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.571280:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211c00/0xbcb9e331c3f1116a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.571286:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211c00/0xbcb9e331c3f1116a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.571306:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211c00/0xbcb9e331c3f1116a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.571312:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bb5211c00 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432932.571316:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211c00/0xbcb9e331c3f1116a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.571324:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211c00/0xbcb9e331c3f1116a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.571335:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d000) 00010000:00010000:0.0:1787432932.571338:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787432932.571342:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211c00/0xbcb9e331c3f1116a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.571347:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211c00/0xbcb9e331c3f1116a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.571359:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210600/0xbcb9e331c3f1115c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.571371:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210600/0xbcb9e331c3f1115c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.571377:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210600/0xbcb9e331c3f1115c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.571381:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bb5210600 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:0.0:1787432932.571384:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210600/0xbcb9e331c3f1115c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.571390:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210600/0xbcb9e331c3f1115c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.571398:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d000) 00010000:00010000:0.0:1787432932.571400:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787432932.571404:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210600/0xbcb9e331c3f1115c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.571409:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5210600/0xbcb9e331c3f1115c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787432932.571650:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+17:14575:x1874258791890944:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 19283us (19509us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1787432932.571686:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 60 00000020:00080000:0.0:1787432932.571692:0:14355:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787432932.572133:0:14389:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787432932.572138:0:14389:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787432932.572178:0:14389:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787432932.572184:0:14389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787432932.578840:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791891200 00000100:00100000:3.0:1787432932.578862:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791891200 00000100:00100000:3.0:1787432932.579017:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:3.0:1787432932.579028:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+17:14574:x1874258791891200:12345-192.168.202.15@tcp:49:bash.0 00000100:00100000:3.0:1787432932.579176:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+17:14574:x1874258791891200:12345-192.168.202.15@tcp:49:bash.0 Request processed in 150us (8196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432932.579185:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:3.0:1787432932.579276:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432932.580858:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791891456 00000100:00100000:0.0:1787432932.580872:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791891456 00000100:00100000:0.0:1787432932.580915:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:0.0:1787432932.580925:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+17:14575:x1874258791891456:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787432932.581830:0:14359:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787432932.581940:0:14359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1787432932.581990:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211800/0xbcb9e331c3f11171 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.582008:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211800/0xbcb9e331c3f11171 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.582020:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211800/0xbcb9e331c3f11171 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.582030:0:14359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211800/0xbcb9e331c3f11171 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.582036:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211800/0xbcb9e331c3f11171 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.582042:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211800/0xbcb9e331c3f11171 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.582205:0:14359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787432932.582545:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+19:14575:x1874258791891456:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 1617us (3276us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1787432932.582556:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000020:00080000:0.0:1787432932.582561:0:14359:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787432932.585508:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787432932.585524:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211800/0xbcb9e331c3f11171 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.585537:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935bb5211800 already unused, calling callback (ffffffffc1752230) 00010000:00010000:1.0:1787432932.585541:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211800/0xbcb9e331c3f11171 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.585550:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211800/0xbcb9e331c3f11171 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432932.586041:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:1.0:1787432932.586182:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff935b9838fa00) 00010000:00010000:1.0:1787432932.586186:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787432932.586193:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211800/0xbcb9e331c3f11171 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.586199:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bb5211800/0xbcb9e331c3f11171 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787432932.586227:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432932.586230:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432932.586232:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787432932.586527:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791891584 00000100:00100000:0.0:1787432932.586539:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791891584 00000100:00100000:0.0:1787432932.586595:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:0.0:1787432932.586606:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+7:14574:x1874258791891584:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787432932.586623:0:15040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787432932.586679:0:15040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8996b94/0xbcb9e331c3f11178 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a02614e expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787432932.586714:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a8a0fe3, atime: 0x6a8a0fe1, ctime: 0x6a8a0fe3, blocks: 0x1 00010000:00010000:0.0:1787432932.586738:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1787432932.586743:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787432932.586753:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8996b94/0xbcb9e331c3f11178 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02614e expref: 8 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.586770:0:15040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8996b94/0xbcb9e331c3f11178 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a02614e expref: 8 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787432932.586783:0:15040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bb5211600, rc 0) 00000100:00100000:0.0:1787432932.586848:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+8:14574:x1874258791891584:12345-192.168.202.15@tcp:101:bash.0 Request processed in 244us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432932.586856:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:0.0:1787432932.590618:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432932.590800:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791891840 00000100:00100000:2.0:1787432932.590810:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791891840 00000100:00100000:2.0:1787432932.590878:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:2.0:1787432932.590889:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+19:14574:x1874258791891840:12345-192.168.202.15@tcp:35:bash.0 00000001:00080000:2.0:1787432932.591196:0:14359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1787432932.591287:0:14359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1787432932.591416:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+22:14574:x1874258791891840:12345-192.168.202.15@tcp:35:bash.0 Request processed in 528us (808us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1787432932.591424:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00000020:00080000:2.0:1787432932.591430:0:14359:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787432932.710933:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432932.711037:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791892096 00000100:00100000:2.0:1787432932.711048:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791892096 00000100:00100000:2.0:1787432932.711114:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:2.0:1787432932.711125:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+22:14585:x1874258791892096:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787432932.711153:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787432932.711175:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f1117f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93816182a026155 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787432932.711710:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787432932.712012:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f1117f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026155 expref: 24 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.712030:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff935b9826d400) 00010000:00010000:2.0:1787432932.712033:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787432932.712039:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935bbaa5ec00/0xbcb9e331c3f1117f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x93816182a026155 expref: 24 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787432932.712053:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff935bbaa5ec00, rc 0) 00000100:00100000:2.0:1787432932.712125:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1437e822-c48b-4d58-8b99-8f0f7949835b+23:14585:x1874258791892096:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1000us (1201us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1787432932.712133:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:0.0:1787432932.718200:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432932.718315:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791892224 00000100:00100000:3.0:1787432932.718327:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791892224 00000100:00100000:3.0:1787432932.718388:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:3.0:1787432932.718400:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+23:14585:x1874258791892224:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:3.0:1787432932.718477:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f1118d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.718494:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f1118d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.718506:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f1118d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.718531:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030200/0xbcb9e331c3f11194 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.718538:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030200/0xbcb9e331c3f11194 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.718567:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030200/0xbcb9e331c3f11194 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.718912:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f1119b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.718921:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f1119b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.718929:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f1119b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787432932.718968:0:14356:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f1119b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.718980:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f1118d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.718987:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f1118d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.718993:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f1118d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.718999:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031000 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432932.719003:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f1118d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.719010:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f1118d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.719024:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff935b952e8c00) 00010000:00010000:3.0:1787432932.719033:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432932.719038:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f1118d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.719045:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031000/0xbcb9e331c3f1118d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.719062:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030200/0xbcb9e331c3f11194 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.719068:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030200/0xbcb9e331c3f11194 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.719074:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030200/0xbcb9e331c3f11194 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.719080:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80030200 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432932.719083:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030200/0xbcb9e331c3f11194 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.719089:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030200/0xbcb9e331c3f11194 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.719097:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff935b9826d600) 00010000:00010000:3.0:1787432932.719100:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432932.719103:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030200/0xbcb9e331c3f11194 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.719109:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80030200/0xbcb9e331c3f11194 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.719128:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f1119b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.719141:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f1119b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.719147:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f1119b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.719152:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935b80031400 already unused, calling callback (ffffffffc21914f0) 00010000:00010000:3.0:1787432932.719155:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f1119b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.719161:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f1119b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.719168:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff935b9826d000) 00010000:00010000:3.0:1787432932.719170:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787432932.719173:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f1119b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787432932.719179:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff935b80031400/0xbcb9e331c3f1119b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787432932.719262:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+23:14585:x1874258791892224:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 864us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432932.719270:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:0.0:1787432932.723966:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787432932.724059:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791892480 00000100:00100000:2.0:1787432932.724070:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791892480 00000100:00100000:2.0:1787432932.724129:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:2.0:1787432932.724139:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+23:14585:x1874258791892480:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787432932.724698:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+24:14585:x1874258791892480:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 519us (701us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1787432932.724707:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00010000:00010000:0.0:1787432933.493901:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787432934.519122:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787432934.651393:0:16629:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:1.0:1787432935.357718:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432935.357796:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432935.357884:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791892736 00000100:00100000:3.0:1787432935.357897:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791892736 00000100:00100000:3.0:1787432935.357971:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:3.0:1787432935.357981:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935b9f026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+8:2378:x1874258791892736:12345-192.168.202.15@tcp:16:kworker.0 00000100:00100000:3.0:1787432935.358139:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935b9f026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1437e822-c48b-4d58-8b99-8f0f7949835b+8:2378:x1874258791892736:12345-192.168.202.15@tcp:16:kworker.0 Request processed in 158us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432935.358164:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00080000:1.0:1787432935.358951:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787432935.359029:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791892608 00000100:00100000:2.0:1787432935.359037:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791892608 00002000:00100000:2.0:1787432935.359075:0:15045:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff935bbaa63480 x1874258791892608/t0(0) o4->1437e822-c48b-4d58-8b99-8f0f7949835b@192.168.202.15@tcp:646/0 lens 504/0 e 0 to 0 dl 1787432946 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787432935.359087:0:15045:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935bbaa63480 with x1874258791892608 ext(0->8) 00002000:00010000:2.0:1787432935.359093:0:15045:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff935bbaa63480 00000100:00100000:2.0:1787432935.359127:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:2.0:1787432935.359137:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+8:2378:x1874258791892608:12345-192.168.202.15@tcp:4:bash.0 00000100:00100000:2.0:1787432935.359699:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+10:2378:x1874258791892608:12345-192.168.202.15@tcp:4:bash.0 Request processed in 562us (1993us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787432935.359708:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00002000:00100000:2.0:1787432935.359716:0:15045:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff935bbaa63480 x1874258791892608/t8589934598(0) o4->1437e822-c48b-4d58-8b99-8f0f7949835b@192.168.202.15@tcp:646/0 lens 504/448 e 0 to 0 dl 1787432946 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787432935.359725:0:15045:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff935bbaa63480 with x1874258791892608 ext(0->8) 00002000:00010000:2.0:1787432935.359729:0:15045:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff935bbaa63480 00010000:00010000:1.0:1787432935.542890:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787432936.379384:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787432936.379432:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432936.379603:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791892864 00000100:00100000:0.0:1787432936.379623:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791892864 00000100:00100000:0.0:1787432936.379761:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 127 00000100:00100000:0.0:1787432936.379776:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba8e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+13:2375:x1874258791892864:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787432936.379896:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba8e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d50bdb12-e88c-4003-a207-6f70712558c4+13:2375:x1874258791892864:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 123us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432936.379904:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 127 00000100:00100000:0.0:1787432936.379974:0:15772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791892992 00000100:00100000:0.0:1787432936.379979:0:15772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791892992 00000100:00100000:0.0:1787432936.380041:0:15772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:0.0:1787432936.380050:0:15772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bbaa61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+24:2375:x1874258791892992:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432936.380089:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787432936.380105:0:15772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bbaa61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+24:2375:x1874258791892992:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 54us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432936.380113:0:15772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00080000:0.0:1787432936.380143:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787432936.380191:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432936.380250:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432936.380286:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432936.380314:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791893120 00000100:00100000:3.0:1787432936.380324:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791893120 00000100:00100000:0.0:1787432936.380362:0:16590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791893248 00000100:00100000:0.0:1787432936.380370:0:16590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791893248 00000100:00100000:3.0:1787432936.380393:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791893504 00000100:00100000:3.0:1787432936.380399:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791893504 00000100:00100000:0.0:1787432936.380416:0:16590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:0.0:1787432936.380433:0:16590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+10:2375:x1874258791893248:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432936.380443:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:3.0:1787432936.380456:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+5:2374:x1874258791893120:12345-192.168.202.15@tcp:9:kworker.0 00000020:00000080:3.0:1787432936.380490:0:15040:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f10e29 00000100:00100000:0.0:1787432936.380500:0:16590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1437e822-c48b-4d58-8b99-8f0f7949835b+10:2375:x1874258791893248:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 72us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787432936.380510:0:16590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00080000:3.0:1787432936.380512:0:15040:0:(import.c:65:import_set_state_nolock()) ffff935bbb684800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787432936.380539:0:16590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:0.0:1787432936.380548:0:16590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+5:2374:x1874258791893504:12345-192.168.202.15@tcp:9:kworker.0 00000001:00000004:3.0:1787432936.380566:0:15040:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000020:00000080:0.0:1787432936.380579:0:16590:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f10e61 00000100:00080000:0.0:1787432936.380591:0:16590:0:(import.c:65:import_set_state_nolock()) ffff935bbb683000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787432936.380640:0:16590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:0.0:1787432936.380843:0:15366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432936.381202:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1437e822-c48b-4d58-8b99-8f0f7949835b+2:2374:x1874258791893120:12345-192.168.202.15@tcp:9:kworker.0 Request processed in 746us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432936.381212:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:3.0:1787432936.381255:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791893376 00000100:00100000:3.0:1787432936.381289:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791893376 00000100:00100000:3.0:1787432936.381338:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:3.0:1787432936.381347:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bb9fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+6:2375:x1874258791893376:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787432936.381402:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+6:2375:x1874258791893376:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 57us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432936.381408:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00080000:3.0:1787432936.381461:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787432936.381466:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787432936.381580:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787432936.381802:0:16590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bb9fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+2:2374:x1874258791893504:12345-192.168.202.15@tcp:9:kworker.0 Request processed in 1253us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432936.381827:0:16590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:0.0:1787432936.386854:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787432936.390388:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874258791893632 00000100:00100000:3.0:1787432936.390404:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874258791893632 00000100:00100000:3.0:1787432936.390523:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:3.0:1787432936.390541:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff935bba736680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+5:2374:x1874258791893632:12345-192.168.202.15@tcp:9:kworker.0 00000100:00080000:0.0:1787432936.390567:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1787432936.390583:0:15040:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbcb9e331c3f10e68 00000100:00080000:3.0:1787432936.390606:0:15040:0:(import.c:65:import_set_state_nolock()) ffff935ba6acf000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787432936.390654:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787432936.390689:0:15040:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:3.0:1787432936.390978:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff935bba736680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3518b7f2-8018-4ccd-b342-b1564cc6e0dc+2:2374:x1874258791893632:12345-192.168.202.15@tcp:9:kworker.0 Request processed in 443us (4141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787432936.390987:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 24 Debug log: 30209 lines, 30209 kept, 0 dropped, 0 bad.